[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:16 dist-test-slave-jlzn krb5kdc[18892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:16 dist-test-slave-jlzn krb5kdc[18892](info): set up 2 sockets
Aug 10 03:12:16 dist-test-slave-jlzn krb5kdc[18892](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 03:12:18.098654 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.006s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:18 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:18.257177 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46185
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:46185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:18.578395 18916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:18.578770 18916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:18.578904 18916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:18.585810 18916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:18.585902 18916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:18.585953 18916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:18.586016 18916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:18.586059 18916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:18.595587 18916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:46185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:18.596716 18916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:18.598070 18916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:18.614921 18923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:18.615034 18928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:18.614964 18924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:18.615928 18916 server_base.cc:1034] running on GCE node
I20260810 03:12:18.616696 18916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:18.618001 18916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:18.619207 18916 hybrid_clock.cc:648] HybridClock initialized: now 1786331538619130 us; error 60 us; skew 500 ppm
I20260810 03:12:18.619516 18916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:18 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331538, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:18.622400 18916 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:18.624008 18916 webserver.cc:460] Webserver started at http://127.18.112.126:34779/ using document root <none> and password file <none>
I20260810 03:12:18.624630 18916 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:18.624750 18916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:18.625036 18916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:18.628078 18916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "60ef13a9c935418cb2fe00ae571f07ae"
format_stamp: "Formatted at 2026-08-10 03:12:18 on dist-test-slave-jlzn"
server_key: "37a96642be027d0975b2259d25ecf51d"
server_key_iv: "0657f26f5259d453e18a356a13fb312f"
server_key_version: "encryptionkey@0"
I20260810 03:12:18.629132 18916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "60ef13a9c935418cb2fe00ae571f07ae"
format_stamp: "Formatted at 2026-08-10 03:12:18 on dist-test-slave-jlzn"
server_key: "37a96642be027d0975b2259d25ecf51d"
server_key_iv: "0657f26f5259d453e18a356a13fb312f"
server_key_version: "encryptionkey@0"
I20260810 03:12:18.634199 18916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:12:18.637444 18941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:18.638651 18916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:12:18.638810 18916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "60ef13a9c935418cb2fe00ae571f07ae"
format_stamp: "Formatted at 2026-08-10 03:12:18 on dist-test-slave-jlzn"
server_key: "37a96642be027d0975b2259d25ecf51d"
server_key_iv: "0657f26f5259d453e18a356a13fb312f"
server_key_version: "encryptionkey@0"
I20260810 03:12:18.638978 18916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:18.651149 18916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:18.654697 18916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:18.654947 18916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:18.674083 18916 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:46185
I20260810 03:12:18.674080 19025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:46185 every 8 connection(s)
I20260810 03:12:18.675304 18916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:18.678887 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:18.679169 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18916
I20260810 03:12:18.679445 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:18.681290 18881 external_mini_cluster.cc:1428] Setting key 1d834c68942857235f980fb70fc6df37
I20260810 03:12:18.689735 19026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae: Bootstrap starting.
I20260810 03:12:18.692734 19026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:18.693765 19026 log.cc:824] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:18.696533 19026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae: No bootstrap required, opened a new log
I20260810 03:12:18.703629 19026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } }
I20260810 03:12:18.704068 19026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:18.704159 19026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ef13a9c935418cb2fe00ae571f07ae, State: Initialized, Role: FOLLOWER
I20260810 03:12:18.704893 19026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } }
I20260810 03:12:18.705169 19026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:18.705312 19026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:18.705474 19026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 0 FOLLOWER]: Advancing to term 1
Aug 10 03:12:18 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:18.708292 19026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } }
I20260810 03:12:18.708843 19026 leader_election.cc:302] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60ef13a9c935418cb2fe00ae571f07ae; no voters:
I20260810 03:12:18.709447 19026 leader_election.cc:288] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:18.709559 19038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:18.710961 19038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [term 1 LEADER]: Becoming Leader. State: Replica: 60ef13a9c935418cb2fe00ae571f07ae, State: Running, Role: LEADER
I20260810 03:12:18.711489 19038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } }
I20260810 03:12:18.711898 19026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:18.714993 19040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60ef13a9c935418cb2fe00ae571f07ae. Latest consensus state: current_term: 1 leader_uuid: "60ef13a9c935418cb2fe00ae571f07ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } } }
I20260810 03:12:18.715621 19040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:18.716137 19039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60ef13a9c935418cb2fe00ae571f07ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60ef13a9c935418cb2fe00ae571f07ae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46185 } } }
I20260810 03:12:18.716475 19039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:18.722596 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:18.684834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46712 (local address 127.18.112.126:46185)
0810 03:12:18.685511 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:18.685522 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:18.686829 (+ 1307us) server_negotiation.cc:407] Connection header received
0810 03:12:18.695774 (+ 8945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:18.695794 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:18.696167 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:18.696498 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:18.699161 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:18.700554 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:18.702118 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:18.702783 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:18.703029 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:18.709469 (+ 6440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:18.709480 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:18.709496 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:18.709566 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:18.714434 (+ 4868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:18.715562 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:18.715570 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:18.715577 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:18.715793 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:18.716566 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:18.716571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:18.716574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:18.717442 (+ 868us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:18.717803 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:18.720838 (+ 3035us) server_negotiation.cc:299] Negotiation successful
0810 03:12:18.721263 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":302,"threads_started":1}
I20260810 03:12:18.727630 19047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:18.733011 19047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:18.740641 19047 catalog_manager.cc:1347] Generated new cluster ID: 79d66830ef3a4e73bede717a5d2291a8
I20260810 03:12:18.740741 19047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:18.750878 19047 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:18.752094 19047 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:18.768606 19047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60ef13a9c935418cb2fe00ae571f07ae: Generated new TSK 0
I20260810 03:12:18.769285 19047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:18.812808 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:19.139434 19073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:19.139703 19073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:19.139817 19073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:19.146821 19073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:19.146912 19073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:19.147028 19073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:19.156275 19073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:19.157410 19073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:19.158644 19073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:19.171134 19085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:19.171089 19089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:19.171388 19083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:19.172150 19073 server_base.cc:1034] running on GCE node
I20260810 03:12:19.172763 19073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:19.173599 19073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:19.174794 19073 hybrid_clock.cc:648] HybridClock initialized: now 1786331539174737 us; error 47 us; skew 500 ppm
I20260810 03:12:19.175063 19073 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:19 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:19.177986 19073 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:19.179272 19073 webserver.cc:460] Webserver started at http://127.18.112.65:43489/ using document root <none> and password file <none>
I20260810 03:12:19.179950 19073 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:19.180056 19073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:19.180311 19073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:19.183394 19073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "809702059f744a949d905b5a6ae2ff3e"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "a4a31df59d085528f1ce36987218b5a4"
server_key_iv: "733439189f8e8eba5838c3c6d3027354"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.184209 19073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "809702059f744a949d905b5a6ae2ff3e"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "a4a31df59d085528f1ce36987218b5a4"
server_key_iv: "733439189f8e8eba5838c3c6d3027354"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.189113 19073 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 03:12:19.192392 19100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.193545 19073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 03:12:19.193702 19073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "809702059f744a949d905b5a6ae2ff3e"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "a4a31df59d085528f1ce36987218b5a4"
server_key_iv: "733439189f8e8eba5838c3c6d3027354"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.193888 19073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:19.214017 19073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:19.217541 19073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:19.217785 19073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:19.218696 19073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:19.219911 19073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:19.219987 19073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.220103 19073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:19.220156 19073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.255256 19073 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:39783
I20260810 03:12:19.255317 19264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:39783 every 8 connection(s)
I20260810 03:12:19.256476 19073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:19.266942 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19073
I20260810 03:12:19.267187 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:19.267985 18881 external_mini_cluster.cc:1428] Setting key 8e8937dfb7227f02dbe41cb258329f8e
Aug 10 03:12:19 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:19.277621 19268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:19.258904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:47483 (local address 127.18.112.126:46185)
0810 03:12:19.259355 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:19.259362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:19.260304 (+ 942us) server_negotiation.cc:407] Connection header received
0810 03:12:19.262019 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:19.262023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:19.262088 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:19.262181 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:19.263475 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.264241 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.265649 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.266044 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.266137 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:19.269823 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:19.269829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:19.269834 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:19.269870 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:19.274665 (+ 4795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:19.275464 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:19.275468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:19.275470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:19.275604 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:19.276045 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:19.276048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:19.276050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:19.276306 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:19.276417 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:19.277199 (+ 782us) server_negotiation.cc:299] Negotiation successful
0810 03:12:19.277368 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":210,"threads_started":1}
I20260810 03:12:19.278869 19273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:19.259458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46185 (local address 127.18.112.65:47483)
0810 03:12:19.260157 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:19.260192 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:19.261785 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:19.262357 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:19.262364 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:19.262827 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:19.263344 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:19.263361 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.264353 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.264356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:19.265529 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:19.265541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.266216 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.266221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:19.266401 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:19.267019 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:19.267057 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:19.269590 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:19.274800 (+ 5210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:19.274809 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:19.274822 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:19.275372 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:19.275702 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:19.275706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:19.275709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:19.275944 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:19.276425 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:19.276433 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:19.276810 (+ 377us) client_negotiation.cc:769] Sending connection context
0810 03:12:19.277078 (+ 268us) client_negotiation.cc:240] Negotiation successful
0810 03:12:19.277548 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":278,"threads_started":1}
I20260810 03:12:19.280274 19266 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46185
I20260810 03:12:19.280534 19266 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:19.281165 19266 heartbeater.cc:511] Master 127.18.112.126:46185 requested a full tablet report, sending...
I20260810 03:12:19.283463 18967 ts_manager.cc:194] Registered new tserver with Master: 809702059f744a949d905b5a6ae2ff3e (127.18.112.65:39783)
I20260810 03:12:19.285424 18967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:47483
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:19.310086 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:19.638255 19279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:19.638494 19279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:19.638595 19279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:19.645673 19279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:19.645771 19279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:19.645884 19279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:19.654929 19279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:19.655966 19279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:19.657126 19279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:19.669195 19285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:19.669261 19286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:19.669576 19288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:19.670210 19279 server_base.cc:1034] running on GCE node
I20260810 03:12:19.670755 19279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:19.671571 19279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:19.672775 19279 hybrid_clock.cc:648] HybridClock initialized: now 1786331539672725 us; error 34 us; skew 500 ppm
I20260810 03:12:19.673162 19279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:19 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:19.676397 19279 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:19.678083 19279 webserver.cc:460] Webserver started at http://127.18.112.66:36635/ using document root <none> and password file <none>
I20260810 03:12:19.678870 19279 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:19.678990 19279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:19.679286 19279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:19.682818 19279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "40aae590da694c1192954bb00169c168"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "fd56c10d7f2be7a4faf3d0198139d7bf"
server_key_iv: "ccc069a780a4422a0c30f52caea0bd72"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.683841 19279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "40aae590da694c1192954bb00169c168"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "fd56c10d7f2be7a4faf3d0198139d7bf"
server_key_iv: "ccc069a780a4422a0c30f52caea0bd72"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.690100 19279 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 03:12:19.694128 19297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.695366 19279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:12:19.695499 19279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "40aae590da694c1192954bb00169c168"
format_stamp: "Formatted at 2026-08-10 03:12:19 on dist-test-slave-jlzn"
server_key: "fd56c10d7f2be7a4faf3d0198139d7bf"
server_key_iv: "ccc069a780a4422a0c30f52caea0bd72"
server_key_version: "encryptionkey@0"
I20260810 03:12:19.695683 19279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:19.714584 19279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:19.718474 19279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:19.718751 19279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:19.719659 19279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:19.721051 19279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:19.721122 19279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.721233 19279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:19.721284 19279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:19.756712 19279 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:39641
I20260810 03:12:19.756779 19461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:39641 every 8 connection(s)
I20260810 03:12:19.757923 19279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:19.764864 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19279
I20260810 03:12:19.765048 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:19.765460 18881 external_mini_cluster.cc:1428] Setting key d77ceb275501cd8ed0d9fa33ab13fd95
Aug 10 03:12:19 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:19.776994 19268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:19.760241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:60531 (local address 127.18.112.126:46185)
0810 03:12:19.760411 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:19.760416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:19.761610 (+ 1194us) server_negotiation.cc:407] Connection header received
0810 03:12:19.763360 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:19.763366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:19.763445 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:19.763531 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:19.764977 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.765796 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.767829 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.768231 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.768344 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:19.771876 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:19.771881 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:19.771884 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:19.771916 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:19.774174 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:19.774820 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:19.774824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:19.774826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:19.774955 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:19.775354 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:19.775358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:19.775361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:19.775635 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:19.775765 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:19.776443 (+ 678us) server_negotiation.cc:299] Negotiation successful
0810 03:12:19.776675 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:12:19.777846 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:19.760693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46185 (local address 127.18.112.66:60531)
0810 03:12:19.761470 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:19.761506 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:19.763101 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:19.763767 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:19.763775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:19.764295 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:19.764815 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:19.764832 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.765948 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.765953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:19.767671 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:19.767683 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:19.768452 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:19.768460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:19.768675 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:19.769395 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:19.769421 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:19.771647 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:19.774298 (+ 2651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:19.774307 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:19.774321 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:19.774710 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:19.775057 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:19.775061 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:19.775065 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:19.775248 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:19.775756 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:19.775763 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:19.776089 (+ 326us) client_negotiation.cc:769] Sending connection context
0810 03:12:19.776330 (+ 241us) client_negotiation.cc:240] Negotiation successful
0810 03:12:19.776793 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":366,"threads_started":1}
I20260810 03:12:19.779245 19462 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46185
I20260810 03:12:19.779501 19462 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:19.780262 19462 heartbeater.cc:511] Master 127.18.112.126:46185 requested a full tablet report, sending...
I20260810 03:12:19.781778 18967 ts_manager.cc:194] Registered new tserver with Master: 40aae590da694c1192954bb00169c168 (127.18.112.66:39641)
I20260810 03:12:19.782850 18967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:60531
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:19.808856 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:43037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:20.126482 19473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:20.126737 19473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:20.126837 19473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:20.133996 19473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:20.134096 19473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:20.134212 19473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:20.143672 19473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46185
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:20.144781 19473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:20.146005 19473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:20.158176 19484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:20.158327 19487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:20.158351 19481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:20.159116 19473 server_base.cc:1034] running on GCE node
I20260810 03:12:20.159657 19473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:20.160527 19473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:20.161722 19473 hybrid_clock.cc:648] HybridClock initialized: now 1786331540161667 us; error 45 us; skew 500 ppm
I20260810 03:12:20.162005 19473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:20.164881 19473 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:20.166230 19473 webserver.cc:460] Webserver started at http://127.18.112.67:46865/ using document root <none> and password file <none>
I20260810 03:12:20.166903 19473 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:20.167032 19473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:20.167310 19473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:20.170135 19473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "ceb9e25634d44d629a816d2dea2c1cf2"
format_stamp: "Formatted at 2026-08-10 03:12:20 on dist-test-slave-jlzn"
server_key: "048adde7474c674ad80f19c4dcd077cf"
server_key_iv: "a2eaeb7721128c28d09c49e67c188c21"
server_key_version: "encryptionkey@0"
I20260810 03:12:20.170892 19473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "ceb9e25634d44d629a816d2dea2c1cf2"
format_stamp: "Formatted at 2026-08-10 03:12:20 on dist-test-slave-jlzn"
server_key: "048adde7474c674ad80f19c4dcd077cf"
server_key_iv: "a2eaeb7721128c28d09c49e67c188c21"
server_key_version: "encryptionkey@0"
I20260810 03:12:20.175679 19473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260810 03:12:20.178835 19499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:20.180032 19473 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:20.180173 19473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "ceb9e25634d44d629a816d2dea2c1cf2"
format_stamp: "Formatted at 2026-08-10 03:12:20 on dist-test-slave-jlzn"
server_key: "048adde7474c674ad80f19c4dcd077cf"
server_key_iv: "a2eaeb7721128c28d09c49e67c188c21"
server_key_version: "encryptionkey@0"
I20260810 03:12:20.180361 19473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:20.192731 19473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:20.196455 19473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:20.196715 19473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:20.197651 19473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:20.198980 19473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:20.199060 19473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:20.199177 19473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:20.199234 19473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:20.234298 19473 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:39879
I20260810 03:12:20.234351 19669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:39879 every 8 connection(s)
I20260810 03:12:20.235493 19473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:20.242796 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19473
I20260810 03:12:20.242988 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:20.243556 18881 external_mini_cluster.cc:1428] Setting key 2ea0f7cd6d664d60f22533eef6fa5de5
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:20.255241 19268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.238075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:48253 (local address 127.18.112.126:46185)
0810 03:12:20.238253 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.238257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.239524 (+ 1267us) server_negotiation.cc:407] Connection header received
0810 03:12:20.241338 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.241343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.241436 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.241523 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.243021 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.244295 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.246219 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.246705 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.246793 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.250084 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.250089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.250092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.250123 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.252488 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.253137 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.253142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.253145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.253268 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.253673 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.253677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.253679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.253926 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.254056 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.254711 (+ 655us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.254917 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:12:20.256064 19672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.238474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46185 (local address 127.18.112.67:48253)
0810 03:12:20.239242 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:20.239289 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:20.241079 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:20.241762 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:20.241770 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:20.242282 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:20.242852 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:20.242870 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.244465 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.244470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:20.246101 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:20.246116 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.246921 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.246930 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:20.247190 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.247793 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:20.247839 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:20.249900 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:20.252620 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:20.252628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:20.252642 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:20.253029 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:20.253370 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:20.253375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:20.253379 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:20.253560 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:20.254047 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:20.254054 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:20.254362 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 03:12:20.254582 (+ 220us) client_negotiation.cc:240] Negotiation successful
0810 03:12:20.255037 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":352,"threads_started":1}
I20260810 03:12:20.257413 19670 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46185
I20260810 03:12:20.257716 19670 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:20.258527 19670 heartbeater.cc:511] Master 127.18.112.126:46185 requested a full tablet report, sending...
I20260810 03:12:20.260258 18967 ts_manager.cc:194] Registered new tserver with Master: ceb9e25634d44d629a816d2dea2c1cf2 (127.18.112.67:39879)
I20260810 03:12:20.261019 18967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:48253
I20260810 03:12:20.271165 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:12:20.288156 19266 heartbeater.cc:503] Master 127.18.112.126:46185 was elected leader, sending a full tablet report...
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:20.320333 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.305794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49578 (local address 127.18.112.65:39783)
0810 03:12:20.307007 (+ 1213us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.307014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.307037 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:12:20.307088 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.307093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.307290 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.307419 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.308728 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.309728 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.310929 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.311527 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.311627 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.315437 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.315447 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.315461 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.315491 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.317980 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.318648 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.318654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.318656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.318768 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.319034 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.319037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.319039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.319343 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.319562 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.319762 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.319985 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1071,"thread_start_us":932,"threads_started":1}
W20260810 03:12:20.321473 19146 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:20.364548 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.352377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49594 (local address 127.18.112.65:39783)
0810 03:12:20.352567 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.352573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.352904 (+ 331us) server_negotiation.cc:407] Connection header received
0810 03:12:20.353038 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.353044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.353148 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.353236 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.354372 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.355025 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.356220 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.356632 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.356733 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.360326 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.360331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.360335 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.360365 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.362650 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.363161 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.363164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.363166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.363274 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.363527 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.363530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.363532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.363751 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.363957 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.364160 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.364321 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:12:20.365901 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19073
I20260810 03:12:20.377275 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.366701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49606 (local address 127.18.112.65:39783)
0810 03:12:20.366845 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.366850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.367113 (+ 263us) server_negotiation.cc:407] Connection header received
0810 03:12:20.367243 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.367248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.367307 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.367379 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.368532 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.369182 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.370378 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.370814 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.370917 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.372902 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.372908 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.372911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.372938 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.374957 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.375522 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.375527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.375531 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.375665 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.376027 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.376033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.376036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.376274 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.376497 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.376778 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.376964 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:12:20.377862 19257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:20.458626 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19073
I20260810 03:12:20.479143 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19279
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:20.494128 19686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.479983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.18.112.66:39641)
0810 03:12:20.480487 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.480494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.480518 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:12:20.480575 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.480581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.480776 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.480923 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.482082 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.483079 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.484375 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.485088 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.485227 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.489074 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.489085 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.489099 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.489139 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.491648 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.492377 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.492384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.492387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.492534 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.492889 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.492892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.492895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.493222 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.493445 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.493662 (+ 217us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.493854 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260810 03:12:20.495293 19455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:20.576136 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19279
I20260810 03:12:20.595693 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19473
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[18892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:20.611186 19688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:20.596684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.18.112.67:39879)
0810 03:12:20.597313 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:20.597320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:20.597349 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:12:20.597409 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:20.597415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:20.597614 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:20.597757 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:20.599016 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.600216 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.601449 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:20.601993 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:20.602103 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:20.605930 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:20.605940 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:20.605953 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:20.605985 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:20.608607 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.609216 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.609223 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.609225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.609346 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:20.609693 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:20.609697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:20.609699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:20.610032 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:20.610331 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:20.610608 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 03:12:20.610862 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":327,"threads_started":1}
I20260810 03:12:20.612498 19662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:20.692891 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19473
I20260810 03:12:20.714385 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18916
I20260810 03:12:20.715564 19016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:20.815387 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18916
2026-08-10T03:12:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3939 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[19698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[19698](info): set up 2 sockets
Aug 10 03:12:20 dist-test-slave-jlzn krb5kdc[19698](info): commencing operation
krb5kdc: starting...
W20260810 03:12:21.984193 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:22 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:22.142560 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46463
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:46463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:22.443101 19716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:22.443390 19716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:22.443523 19716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:22.450366 19716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:22.450471 19716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:22.450548 19716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:22.450629 19716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:22.450690 19716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:22.459897 19716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:46463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:22.461059 19716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:22.462234 19716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:22.473006 19724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:22.472962 19726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:22.473026 19729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:22.473836 19716 server_base.cc:1034] running on GCE node
I20260810 03:12:22.474520 19716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:22.475982 19716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:22.477180 19716 hybrid_clock.cc:648] HybridClock initialized: now 1786331542477128 us; error 42 us; skew 500 ppm
I20260810 03:12:22.477494 19716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:22 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331542, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:22.483480 19716 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:22.484833 19716 webserver.cc:460] Webserver started at http://127.18.112.126:39753/ using document root <none> and password file <none>
I20260810 03:12:22.485433 19716 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:22.485549 19716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:22.485845 19716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:22.488726 19716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "23a4ba8bd43d47eba28a1bccfa420457"
format_stamp: "Formatted at 2026-08-10 03:12:22 on dist-test-slave-jlzn"
server_key: "8de2707f3c6d4cc75d9e451291584e96"
server_key_iv: "5740072513b57e77aa53a76ad6c785df"
server_key_version: "encryptionkey@0"
I20260810 03:12:22.489427 19716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "23a4ba8bd43d47eba28a1bccfa420457"
format_stamp: "Formatted at 2026-08-10 03:12:22 on dist-test-slave-jlzn"
server_key: "8de2707f3c6d4cc75d9e451291584e96"
server_key_iv: "5740072513b57e77aa53a76ad6c785df"
server_key_version: "encryptionkey@0"
I20260810 03:12:22.494336 19716 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:12:22.497484 19748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:22.498616 19716 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 03:12:22.498786 19716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "23a4ba8bd43d47eba28a1bccfa420457"
format_stamp: "Formatted at 2026-08-10 03:12:22 on dist-test-slave-jlzn"
server_key: "8de2707f3c6d4cc75d9e451291584e96"
server_key_iv: "5740072513b57e77aa53a76ad6c785df"
server_key_version: "encryptionkey@0"
I20260810 03:12:22.498957 19716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:22.519982 19716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:22.523422 19716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:22.523665 19716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:22.540266 19716 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:46463
I20260810 03:12:22.540302 19827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:46463 every 8 connection(s)
I20260810 03:12:22.541471 19716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:22.544008 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19716
I20260810 03:12:22.544212 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:22.544844 18881 external_mini_cluster.cc:1428] Setting key a7c85a55164766ed77b46f38bb7264bc
I20260810 03:12:22.545035 19829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:22.558233 19829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457: Bootstrap starting.
Aug 10 03:12:22 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:22.561759 19829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:22.563016 19829 log.cc:824] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:22.566148 19829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457: No bootstrap required, opened a new log
I20260810 03:12:22.567863 19835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:22.546589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.18.112.126:46463)
0810 03:12:22.547311 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:22.547322 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:22.547359 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:12:22.549438 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:22.549464 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:22.549910 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:22.550315 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:22.551573 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:22.553651 (+ 2078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:22.554842 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:22.555915 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:22.556123 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:22.559870 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:22.559881 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:22.559898 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:22.559944 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:22.563568 (+ 3624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:22.564361 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:22.564369 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:22.564377 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:22.564566 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:22.564882 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:22.564887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:22.564890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:22.565544 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:22.565826 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:22.566207 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 03:12:22.566612 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":327,"threads_started":1}
I20260810 03:12:22.574157 19829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } }
I20260810 03:12:22.574471 19829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:22.574592 19829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a4ba8bd43d47eba28a1bccfa420457, State: Initialized, Role: FOLLOWER
I20260810 03:12:22.575124 19829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } }
I20260810 03:12:22.575337 19829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:22.575433 19829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:22.575562 19829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:22.577521 19829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } }
I20260810 03:12:22.577929 19829 leader_election.cc:302] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23a4ba8bd43d47eba28a1bccfa420457; no voters:
I20260810 03:12:22.578397 19829 leader_election.cc:288] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:22.578518 19838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:22.579118 19838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [term 1 LEADER]: Becoming Leader. State: Replica: 23a4ba8bd43d47eba28a1bccfa420457, State: Running, Role: LEADER
I20260810 03:12:22.579682 19838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } }
I20260810 03:12:22.580233 19829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:22.582209 19844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23a4ba8bd43d47eba28a1bccfa420457. Latest consensus state: current_term: 1 leader_uuid: "23a4ba8bd43d47eba28a1bccfa420457" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } } }
I20260810 03:12:22.582571 19844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:22.583526 19842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23a4ba8bd43d47eba28a1bccfa420457" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a4ba8bd43d47eba28a1bccfa420457" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46463 } } }
I20260810 03:12:22.584091 19842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:22.584784 19851 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:22.589532 19851 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:22.597024 19851 catalog_manager.cc:1347] Generated new cluster ID: b4614b4281ec43b7b3499d0a76af933d
I20260810 03:12:22.597116 19851 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:22.617416 19851 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:22.618646 19851 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:22.641350 19851 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23a4ba8bd43d47eba28a1bccfa420457: Generated new TSK 0
I20260810 03:12:22.642107 19851 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:22.690478 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:23.035516 19875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:23.035789 19875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:23.035954 19875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:23.042768 19875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:23.042878 19875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:23.043030 19875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:23.052296 19875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:23.053396 19875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:23.054633 19875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:23.067905 19885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.067870 19886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.067952 19889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:23.068610 19875 server_base.cc:1034] running on GCE node
I20260810 03:12:23.069160 19875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:23.070026 19875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:23.071234 19875 hybrid_clock.cc:648] HybridClock initialized: now 1786331543071180 us; error 49 us; skew 500 ppm
I20260810 03:12:23.071485 19875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:23 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:23.074358 19875 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:23.075603 19875 webserver.cc:460] Webserver started at http://127.18.112.65:34429/ using document root <none> and password file <none>
I20260810 03:12:23.076258 19875 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:23.076378 19875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:23.076658 19875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:23.079281 19875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "9413484cda6f4a058154688fdb9f8c6a"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "5a36b57dd96ce1f6d2c15552fd72c937"
server_key_iv: "d8baf762088abc712b518d63df88c00e"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.080090 19875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "9413484cda6f4a058154688fdb9f8c6a"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "5a36b57dd96ce1f6d2c15552fd72c937"
server_key_iv: "d8baf762088abc712b518d63df88c00e"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.084939 19875 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:12:23.088275 19898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.089452 19875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:12:23.089602 19875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "9413484cda6f4a058154688fdb9f8c6a"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "5a36b57dd96ce1f6d2c15552fd72c937"
server_key_iv: "d8baf762088abc712b518d63df88c00e"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.089778 19875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:23.117709 19875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:23.121181 19875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:23.121428 19875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:23.122282 19875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:23.123468 19875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:23.123543 19875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.123667 19875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:23.123720 19875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.153066 19875 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:33003
I20260810 03:12:23.153122 20075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:33003 every 8 connection(s)
I20260810 03:12:23.154206 19875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:23.156438 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19875
I20260810 03:12:23.156664 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:23.157315 18881 external_mini_cluster.cc:1428] Setting key 701c9f57f346cbdcf8eb7f78d758e31d
Aug 10 03:12:23 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:23.174229 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:23.156463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:41235 (local address 127.18.112.126:46463)
0810 03:12:23.156928 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:23.156934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:23.157889 (+ 955us) server_negotiation.cc:407] Connection header received
0810 03:12:23.159915 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:23.159921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:23.159995 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:23.160092 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:23.161474 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.162509 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.164442 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.165036 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.165177 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:23.168791 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:23.168796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:23.168799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:23.168831 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:23.171211 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:23.172103 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:23.172107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:23.172109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:23.172235 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:23.172693 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:23.172695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:23.172697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:23.172930 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:23.173040 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:23.173805 (+ 765us) server_negotiation.cc:299] Negotiation successful
0810 03:12:23.173972 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":230,"threads_started":1}
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:12:23.175503 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:23.156975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46463 (local address 127.18.112.65:41235)
0810 03:12:23.157716 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:23.157769 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:23.159652 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:23.160295 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:23.160303 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:23.160779 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:23.161310 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:23.161326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.162654 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.162658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:23.164253 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:23.164268 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.165225 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.165230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:23.165415 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:23.166004 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:23.166032 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:23.168578 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:23.171356 (+ 2778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:23.171365 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:23.171381 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:23.171997 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:23.172332 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:23.172337 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:23.172341 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:23.172581 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:23.173046 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:23.173054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:23.173440 (+ 386us) client_negotiation.cc:769] Sending connection context
0810 03:12:23.173729 (+ 289us) client_negotiation.cc:240] Negotiation successful
0810 03:12:23.174212 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":292,"threads_started":1}
I20260810 03:12:23.176954 20076 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46463
I20260810 03:12:23.177205 20076 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:23.177865 20076 heartbeater.cc:511] Master 127.18.112.126:46463 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
I20260810 03:12:23.180138 19769 ts_manager.cc:194] Registered new tserver with Master: 9413484cda6f4a058154688fdb9f8c6a (127.18.112.65:33003)
I20260810 03:12:23.182030 19769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:41235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:23.197944 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:23.498328 20083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:23.498569 20083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:23.498670 20083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:23.505555 20083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:23.505645 20083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:23.505756 20083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:23.514715 20083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:23.515779 20083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:23.517023 20083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:23.529003 20092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.529045 20089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.529071 20088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:23.529920 20083 server_base.cc:1034] running on GCE node
I20260810 03:12:23.530504 20083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:23.531334 20083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:23.532518 20083 hybrid_clock.cc:648] HybridClock initialized: now 1786331543532474 us; error 38 us; skew 500 ppm
I20260810 03:12:23.532799 20083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:23 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:23.535635 20083 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:23.536988 20083 webserver.cc:460] Webserver started at http://127.18.112.66:33045/ using document root <none> and password file <none>
I20260810 03:12:23.537652 20083 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:23.537774 20083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:23.538066 20083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:23.541374 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "ab1495d8659f47b4882f285b770eaf1f"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "c12b16524d5f89df3b619247b1527c22"
server_key_iv: "ab6d484d53afb6c3863340bff9c3f506"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.542346 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "ab1495d8659f47b4882f285b770eaf1f"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "c12b16524d5f89df3b619247b1527c22"
server_key_iv: "ab6d484d53afb6c3863340bff9c3f506"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.548488 20083 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260810 03:12:23.552464 20101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.553874 20083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:12:23.554035 20083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "ab1495d8659f47b4882f285b770eaf1f"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "c12b16524d5f89df3b619247b1527c22"
server_key_iv: "ab6d484d53afb6c3863340bff9c3f506"
server_key_version: "encryptionkey@0"
I20260810 03:12:23.554248 20083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:23.574676 20083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:23.578501 20083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:23.578733 20083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:23.579555 20083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:23.580850 20083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:23.580920 20083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.581019 20083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:23.581077 20083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:23.608496 20083 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:39025
I20260810 03:12:23.608542 20281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:39025 every 8 connection(s)
I20260810 03:12:23.609651 20083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:23.610795 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20083
I20260810 03:12:23.610991 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:23.611573 18881 external_mini_cluster.cc:1428] Setting key eb013c786775a3f5114bb86d9b785608
Aug 10 03:12:23 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
I20260810 03:12:23.628988 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:23.612276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:40105 (local address 127.18.112.126:46463)
0810 03:12:23.612470 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:23.612476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:23.613689 (+ 1213us) server_negotiation.cc:407] Connection header received
0810 03:12:23.615444 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:23.615450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:23.615532 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:23.615616 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:23.617092 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.617810 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.619314 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.619739 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.619877 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:23.623424 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:23.623429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:23.623432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:23.623463 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:23.625944 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:23.626789 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:23.626793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:23.626795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:23.626914 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:23.627368 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:23.627370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:23.627372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:23.627607 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:23.627709 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:23.628557 (+ 848us) server_negotiation.cc:299] Negotiation successful
0810 03:12:23.628724 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 03:12:23.630025 20286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:23.612726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46463 (local address 127.18.112.66:40105)
0810 03:12:23.613522 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:23.613581 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:23.615197 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:23.615902 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:23.615909 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:23.616394 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:23.616928 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:23.616944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.617955 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.617961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:23.619179 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:23.619193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:23.619968 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:23.619975 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:23.620193 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:23.620794 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:23.620819 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:23.623217 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:23.626085 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:23.626094 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:23.626110 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:23.626690 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:23.627013 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:23.627018 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:23.627021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:23.627273 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:23.627729 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:23.627737 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:23.628185 (+ 448us) client_negotiation.cc:769] Sending connection context
0810 03:12:23.628505 (+ 320us) client_negotiation.cc:240] Negotiation successful
0810 03:12:23.629005 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":284,"threads_started":1}
I20260810 03:12:23.631343 20282 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46463
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
I20260810 03:12:23.631677 20282 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:23.632406 20282 heartbeater.cc:511] Master 127.18.112.126:46463 requested a full tablet report, sending...
I20260810 03:12:23.633879 19769 ts_manager.cc:194] Registered new tserver with Master: ab1495d8659f47b4882f285b770eaf1f (127.18.112.66:39025)
I20260810 03:12:23.634867 19769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:40105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:23.650779 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:23.956390 20289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:23.956689 20289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:23.956828 20289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:23.964015 20289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:23.964130 20289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:23.964283 20289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:23.973730 20289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:23.974857 20289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:23.976109 20289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:23.988229 20295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.988288 20296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:23.988402 20299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:23.989120 20289 server_base.cc:1034] running on GCE node
I20260810 03:12:23.989698 20289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:23.990505 20289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:23.991698 20289 hybrid_clock.cc:648] HybridClock initialized: now 1786331543991654 us; error 32 us; skew 500 ppm
I20260810 03:12:23.991993 20289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:23 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:23.994904 20289 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:23.996198 20289 webserver.cc:460] Webserver started at http://127.18.112.67:41193/ using document root <none> and password file <none>
I20260810 03:12:23.996785 20289 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:23.996898 20289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:23.997195 20289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:23.999846 20289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "205204257d6e4590996ee33b7710ea89"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "31580d3f4b1ce8a59bef196cb99b2292"
server_key_iv: "b487dfcca486a5d8e96eebd53e820cf5"
server_key_version: "encryptionkey@0"
I20260810 03:12:24.000628 20289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "205204257d6e4590996ee33b7710ea89"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "31580d3f4b1ce8a59bef196cb99b2292"
server_key_iv: "b487dfcca486a5d8e96eebd53e820cf5"
server_key_version: "encryptionkey@0"
I20260810 03:12:24.005478 20289 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:12:24.008623 20308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:24.009786 20289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:24.009927 20289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "205204257d6e4590996ee33b7710ea89"
format_stamp: "Formatted at 2026-08-10 03:12:23 on dist-test-slave-jlzn"
server_key: "31580d3f4b1ce8a59bef196cb99b2292"
server_key_iv: "b487dfcca486a5d8e96eebd53e820cf5"
server_key_version: "encryptionkey@0"
I20260810 03:12:24.010093 20289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:24.026075 20289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:24.029950 20289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:24.030179 20289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:24.030964 20289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:24.032186 20289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:24.032260 20289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:24.032348 20289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:24.032410 20289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:24.062873 20289 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:34141
I20260810 03:12:24.062927 20475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:34141 every 8 connection(s)
I20260810 03:12:24.064079 20289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:24.073212 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20289
I20260810 03:12:24.073375 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:24.073789 18881 external_mini_cluster.cc:1428] Setting key 1b7227156136c28fb1c5334693b108b8
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:24.083182 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.066348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:60061 (local address 127.18.112.126:46463)
0810 03:12:24.066505 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.066510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.067610 (+ 1100us) server_negotiation.cc:407] Connection header received
0810 03:12:24.069424 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.069430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.069513 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.069603 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.071069 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.071867 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.073663 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.074122 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.074235 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.077815 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.077821 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.077826 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.077862 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.080272 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.080982 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.080987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.080991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.081112 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.081523 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.081528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.081531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.081851 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.081994 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.082618 (+ 624us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.082841 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:12:24.084074 20478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.066760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46463 (local address 127.18.112.67:60061)
0810 03:12:24.067419 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.067455 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.069161 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.069855 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.069864 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.070352 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:24.070903 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.070921 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.072016 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.072020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.073519 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.073533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.074342 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.074349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.074580 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.075257 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:24.075279 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:24.077621 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:24.080395 (+ 2774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:24.080403 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:24.080417 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:24.080873 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:24.081214 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:24.081218 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:24.081223 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:24.081419 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:24.081970 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:24.081977 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:24.082285 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.082514 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.082971 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":254,"threads_started":1}
I20260810 03:12:24.085386 20476 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46463
I20260810 03:12:24.085629 20476 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:24.086269 20476 heartbeater.cc:511] Master 127.18.112.126:46463 requested a full tablet report, sending...
I20260810 03:12:24.087597 19769 ts_manager.cc:194] Registered new tserver with Master: 205204257d6e4590996ee33b7710ea89 (127.18.112.67:34141)
I20260810 03:12:24.088615 19769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:60061
I20260810 03:12:24.088910 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:12:24.106205 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.094907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43310 (local address 127.18.112.126:46463)
0810 03:12:24.095049 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.095053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.095588 (+ 535us) server_negotiation.cc:407] Connection header received
0810 03:12:24.095728 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.095731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.095782 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.095907 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.097310 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.097977 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.099191 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.099586 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.099683 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.101688 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.101692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.101695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.101723 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.104235 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.104791 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.104795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.104797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.104913 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.105173 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.105176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.105178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.105458 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.105640 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.105856 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.106005 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:12:24.111476 19769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:24.118348 19769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:24.152272 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.130244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48494 (local address 127.18.112.66:39025)
0810 03:12:24.138852 (+ 8608us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.138861 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.144959 (+ 6098us) server_negotiation.cc:407] Connection header received
0810 03:12:24.145146 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.145154 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.145379 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.145624 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:24.146343 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.147666 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.149802 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.151227 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.151350 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.151564 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.151821 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.151988 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8446,"thread_start_us":8351,"threads_started":1}
I20260810 03:12:24.152405 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.129498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:39025 (local address 127.0.0.1:48494)
0810 03:12:24.144786 (+ 15288us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.144804 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.144998 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.145668 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.145676 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.145727 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:24.146134 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.146151 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.147788 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.147793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.149638 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.149660 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.151401 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.151407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.151602 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.151642 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.151746 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.151962 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15176,"spinlock_wait_cycles":4096,"thread_start_us":16274,"threads_started":1}
I20260810 03:12:24.154289 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.130426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.18.112.65:33003)
0810 03:12:24.145272 (+ 14846us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.145280 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.145866 (+ 586us) server_negotiation.cc:407] Connection header received
0810 03:12:24.145965 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.145971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.146173 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.147029 (+ 856us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:24.147333 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.148904 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.151267 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.152964 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.153113 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.153299 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.153770 (+ 471us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.153927 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14694,"thread_start_us":14840,"threads_started":1}
I20260810 03:12:24.154874 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.129593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44682 (local address 127.18.112.67:34141)
0810 03:12:24.145161 (+ 15568us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.145169 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.145197 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:12:24.145288 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.145295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.145512 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.145698 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:24.146949 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.148569 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.150673 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.151771 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.153385 (+ 1614us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.153596 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.154057 (+ 461us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.154202 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15371,"thread_start_us":15456,"threads_started":1}
I20260810 03:12:24.155238 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.129326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:34141 (local address 127.0.0.1:44682)
0810 03:12:24.139964 (+ 10638us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.139997 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.140172 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.145972 (+ 5800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.145977 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.146029 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:24.146694 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.146710 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.148708 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.148714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.150528 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.150539 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.153469 (+ 2930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.153476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.153651 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.153682 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.153773 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.153890 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10412,"mutex_wait_us":25,"thread_start_us":15206,"threads_started":1}
I20260810 03:12:24.155294 20494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.129872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:33003 (local address 127.0.0.1:32790)
0810 03:12:24.145589 (+ 15717us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.145607 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.145738 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.146387 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.146392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.146417 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:24.146859 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.146870 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.149033 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.149037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.151089 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.151105 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.153192 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.153199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.153351 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.153382 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.153481 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.153598 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15589,"mutex_wait_us":33,"spinlock_wait_cycles":5376,"thread_start_us":9735,"threads_started":1}
I20260810 03:12:24.158131 20177 tablet_service.cc:1467] Processing CreateTablet for tablet 5056c7ecb31342208fa4c8fb7fb1cffd (DEFAULT_TABLE table=test-table [id=14e23d64be7e41b888173a006afcc61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:24.158818 19976 tablet_service.cc:1467] Processing CreateTablet for tablet 5056c7ecb31342208fa4c8fb7fb1cffd (DEFAULT_TABLE table=test-table [id=14e23d64be7e41b888173a006afcc61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:24.160179 20177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5056c7ecb31342208fa4c8fb7fb1cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:24.160223 19976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5056c7ecb31342208fa4c8fb7fb1cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:24.159785 20390 tablet_service.cc:1467] Processing CreateTablet for tablet 5056c7ecb31342208fa4c8fb7fb1cffd (DEFAULT_TABLE table=test-table [id=14e23d64be7e41b888173a006afcc61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:24.161159 20390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5056c7ecb31342208fa4c8fb7fb1cffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:24.170926 20500 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Bootstrap starting.
I20260810 03:12:24.174015 20500 tablet_bootstrap.cc:654] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:24.174499 20502 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Bootstrap starting.
I20260810 03:12:24.175415 20500 log.cc:824] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:24.175930 20504 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Bootstrap starting.
I20260810 03:12:24.178054 20502 tablet_bootstrap.cc:654] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:24.178884 20504 tablet_bootstrap.cc:654] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:24.179283 20502 log.cc:824] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:24.179576 20500 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: No bootstrap required, opened a new log
I20260810 03:12:24.179900 20500 ts_tablet_manager.cc:1397] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260810 03:12:24.180076 20504 log.cc:824] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:24.182196 20502 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: No bootstrap required, opened a new log
I20260810 03:12:24.182444 20502 ts_tablet_manager.cc:1397] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:12:24.182523 20504 tablet_bootstrap.cc:492] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: No bootstrap required, opened a new log
I20260810 03:12:24.182785 20504 ts_tablet_manager.cc:1397] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260810 03:12:24.184762 20076 heartbeater.cc:503] Master 127.18.112.126:46463 was elected leader, sending a full tablet report...
I20260810 03:12:24.191195 20504 raft_consensus.cc:348] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.191646 20504 raft_consensus.cc:374] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:24.191749 20504 raft_consensus.cc:729] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 205204257d6e4590996ee33b7710ea89, State: Initialized, Role: FOLLOWER
I20260810 03:12:24.192399 20504 consensus_queue.cc:260] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.192988 20500 raft_consensus.cc:348] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.192932 20502 raft_consensus.cc:348] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.193360 20500 raft_consensus.cc:374] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:24.193375 20502 raft_consensus.cc:374] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:24.193460 20502 raft_consensus.cc:729] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1495d8659f47b4882f285b770eaf1f, State: Initialized, Role: FOLLOWER
I20260810 03:12:24.193460 20500 raft_consensus.cc:729] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9413484cda6f4a058154688fdb9f8c6a, State: Initialized, Role: FOLLOWER
I20260810 03:12:24.193501 20476 heartbeater.cc:503] Master 127.18.112.126:46463 was elected leader, sending a full tablet report...
I20260810 03:12:24.194149 20504 ts_tablet_manager.cc:1428] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260810 03:12:24.194104 20500 consensus_queue.cc:260] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.194065 20502 consensus_queue.cc:260] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.196066 20500 ts_tablet_manager.cc:1428] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20260810 03:12:24.196882 20282 heartbeater.cc:503] Master 127.18.112.126:46463 was elected leader, sending a full tablet report...
I20260810 03:12:24.197526 20502 ts_tablet_manager.cc:1428] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
I20260810 03:12:24.312738 20510 raft_consensus.cc:482] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:24.313012 20510 raft_consensus.cc:504] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.314728 20510 leader_election.cc:288] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab1495d8659f47b4882f285b770eaf1f (127.18.112.66:39025), 9413484cda6f4a058154688fdb9f8c6a (127.18.112.65:33003)
W20260810 03:12:24.315639 20477 tablet.cc:2369] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:24.321518 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.315105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:60359 (local address 127.18.112.66:39025)
0810 03:12:24.315307 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.315313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.315891 (+ 578us) server_negotiation.cc:407] Connection header received
0810 03:12:24.315984 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.315990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.316069 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.316179 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:24.316764 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.317618 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.319487 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.320750 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.320913 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.320968 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.321246 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.321332 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:12:24.321769 20478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.314888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:39025 (local address 127.18.112.67:60359)
0810 03:12:24.315271 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.315293 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.315429 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.316360 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.316365 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.316390 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:24.316593 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.316605 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.317742 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.317748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.319326 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.319339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.320897 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.320903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.321096 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.321132 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.321231 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.321363 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260810 03:12:24.322767 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.315144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:40317 (local address 127.18.112.65:33003)
0810 03:12:24.315355 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.315361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.316236 (+ 875us) server_negotiation.cc:407] Connection header received
0810 03:12:24.316428 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.316433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.316510 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.316604 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:24.317490 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.318519 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.320901 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.322073 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.322234 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.322303 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.322504 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.322593 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:12:24.322939 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.315125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:33003 (local address 127.18.112.67:40317)
0810 03:12:24.316062 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.316079 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:24.316285 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:24.316713 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:24.316718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:24.316744 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:24.317316 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.317331 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.318667 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.318671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.320754 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:24.320768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.322247 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.322251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:24.322363 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.322384 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:12:24.322474 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 03:12:24.322589 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":3,"thread_start_us":462,"threads_started":1}
I20260810 03:12:24.322940 20203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5056c7ecb31342208fa4c8fb7fb1cffd" candidate_uuid: "205204257d6e4590996ee33b7710ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab1495d8659f47b4882f285b770eaf1f" is_pre_election: true
I20260810 03:12:24.323565 20203 raft_consensus.cc:2454] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 205204257d6e4590996ee33b7710ea89 in term 0.
I20260810 03:12:24.323937 20007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5056c7ecb31342208fa4c8fb7fb1cffd" candidate_uuid: "205204257d6e4590996ee33b7710ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9413484cda6f4a058154688fdb9f8c6a" is_pre_election: true
I20260810 03:12:24.324254 20312 leader_election.cc:302] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 205204257d6e4590996ee33b7710ea89, ab1495d8659f47b4882f285b770eaf1f; no voters:
I20260810 03:12:24.324499 20007 raft_consensus.cc:2454] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 205204257d6e4590996ee33b7710ea89 in term 0.
I20260810 03:12:24.324656 20510 raft_consensus.cc:2781] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:24.324808 20510 raft_consensus.cc:482] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:24.324914 20510 raft_consensus.cc:3037] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:24.327275 20510 raft_consensus.cc:504] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.327823 20510 leader_election.cc:288] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [CANDIDATE]: Term 1 election: Requested vote from peers ab1495d8659f47b4882f285b770eaf1f (127.18.112.66:39025), 9413484cda6f4a058154688fdb9f8c6a (127.18.112.65:33003)
I20260810 03:12:24.328194 20203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5056c7ecb31342208fa4c8fb7fb1cffd" candidate_uuid: "205204257d6e4590996ee33b7710ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab1495d8659f47b4882f285b770eaf1f"
I20260810 03:12:24.328219 20007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5056c7ecb31342208fa4c8fb7fb1cffd" candidate_uuid: "205204257d6e4590996ee33b7710ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9413484cda6f4a058154688fdb9f8c6a"
I20260810 03:12:24.328351 20203 raft_consensus.cc:3037] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:24.328373 20007 raft_consensus.cc:3037] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:24.330490 20203 raft_consensus.cc:2454] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 205204257d6e4590996ee33b7710ea89 in term 1.
I20260810 03:12:24.330502 20007 raft_consensus.cc:2454] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 205204257d6e4590996ee33b7710ea89 in term 1.
I20260810 03:12:24.330838 20309 leader_election.cc:302] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 205204257d6e4590996ee33b7710ea89, 9413484cda6f4a058154688fdb9f8c6a; no voters:
I20260810 03:12:24.331118 20510 raft_consensus.cc:2781] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:24.331548 20510 raft_consensus.cc:686] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [term 1 LEADER]: Becoming Leader. State: Replica: 205204257d6e4590996ee33b7710ea89, State: Running, Role: LEADER
I20260810 03:12:24.332003 20510 consensus_queue.cc:237] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } }
I20260810 03:12:24.336544 19768 catalog_manager.cc:5495] T 5056c7ecb31342208fa4c8fb7fb1cffd P 205204257d6e4590996ee33b7710ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 205204257d6e4590996ee33b7710ea89 (127.18.112.67). New cstate: current_term: 1 leader_uuid: "205204257d6e4590996ee33b7710ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "205204257d6e4590996ee33b7710ea89" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab1495d8659f47b4882f285b770eaf1f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9413484cda6f4a058154688fdb9f8c6a" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 33003 } health_report { overall_health: UNKNOWN } } }
W20260810 03:12:24.361513 20283 tablet.cc:2369] T 5056c7ecb31342208fa4c8fb7fb1cffd P ab1495d8659f47b4882f285b770eaf1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:24.377961 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.364696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32800 (local address 127.18.112.65:33003)
0810 03:12:24.364846 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.364850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.365308 (+ 458us) server_negotiation.cc:407] Connection header received
0810 03:12:24.365449 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.365453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.365510 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.365587 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.367059 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.367769 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.368952 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.369343 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.369429 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.373097 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.373109 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.373123 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.373161 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.375771 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.376367 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.376375 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.376377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.376498 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.376761 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.376763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.376765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.377114 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.377332 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.377517 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.377664 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260810 03:12:24.406292 20077 tablet.cc:2369] T 5056c7ecb31342208fa4c8fb7fb1cffd P 9413484cda6f4a058154688fdb9f8c6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:24.425047 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.412619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32816 (local address 127.18.112.65:33003)
0810 03:12:24.412792 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.412799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.413200 (+ 401us) server_negotiation.cc:407] Connection header received
0810 03:12:24.413368 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.413372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.413430 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.413508 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.414823 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.415529 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.416794 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.417195 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.417301 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.420807 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.420812 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.420815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.420845 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.423032 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.423533 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.423536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.423539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.423661 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.423977 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.423980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.423982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.424220 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.424419 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.424581 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.424742 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:24.465592 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.453228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32828 (local address 127.18.112.65:33003)
0810 03:12:24.453402 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.453409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.453725 (+ 316us) server_negotiation.cc:407] Connection header received
0810 03:12:24.453879 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.453883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.453942 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.454022 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.455306 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.456006 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.457170 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.457663 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.457772 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.461377 (+ 3605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.461382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.461385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.461423 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.463598 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.464183 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.464186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.464188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.464305 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.464567 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.464570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.464572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.464826 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.465003 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.465171 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.465326 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 03:12:24.467285 19945 tablet_service.cc:2908] Rejecting scan request for tablet 5056c7ecb31342208fa4c8fb7fb1cffd: Uninitialized: clean time has not yet been initialized
I20260810 03:12:24.470146 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19875
I20260810 03:12:24.480762 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.470910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.18.112.65:33003)
0810 03:12:24.471038 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.471042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.471380 (+ 338us) server_negotiation.cc:407] Connection header received
0810 03:12:24.471487 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.471490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.471559 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.471625 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.472681 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.473309 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.474354 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.474725 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.474819 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.476683 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.476687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.476691 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.476718 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.478833 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.479361 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.479364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.479366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.479468 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.479713 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.479716 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.479718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.479971 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.480194 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.480353 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.480524 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:12:24.481309 20069 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:24.568502 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19875
I20260810 03:12:24.592334 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20083
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:24.605659 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.593023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48510 (local address 127.18.112.66:39025)
0810 03:12:24.593190 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.593194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.593212 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:12:24.593362 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.593365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.593427 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.593521 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.594602 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.595336 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.596537 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.596936 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.597025 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.600778 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.600792 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.600807 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.600839 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.603416 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.604099 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.604106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.604108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.604242 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.604522 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.604525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.604527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.604876 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.605133 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.605257 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.605408 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:12:24.606256 20268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:24.690716 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20083
I20260810 03:12:24.715544 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20289
Aug 10 03:12:24 dist-test-slave-jlzn krb5kdc[19698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:24.729246 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.716303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44698 (local address 127.18.112.67:34141)
0810 03:12:24.716739 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:24.716743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:24.716760 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:12:24.716816 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:24.716820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:24.716888 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:24.716976 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:24.718132 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.718804 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.720081 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:24.720470 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:24.720558 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:24.724300 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:24.724314 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:24.724332 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:24.724364 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:24.726948 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.727488 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.727494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.727497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.727646 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:24.727956 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:24.727960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:24.727962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:24.728278 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:24.728503 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:24.728660 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 03:12:24.728820 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":222,"threads_started":1}
I20260810 03:12:24.729897 20469 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:24.730295 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:24.729784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:39025 (local address 127.18.112.67:52009)
0810 03:12:24.729947 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:24.730071 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.66:39025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 03:12:24.730599 20312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.66:39025: connect: Connection refused (error 111)
I20260810 03:12:24.817369 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20289
I20260810 03:12:24.839406 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19716
I20260810 03:12:24.840559 19819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:24.948963 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19716
2026-08-10T03:12:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4132 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:25 dist-test-slave-jlzn krb5kdc[20547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:25 dist-test-slave-jlzn krb5kdc[20547](info): set up 2 sockets
Aug 10 03:12:25 dist-test-slave-jlzn krb5kdc[20547](info): commencing operation
krb5kdc: starting...
W20260810 03:12:26.109146 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:26 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:26.274302 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:42093
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:42093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:26.576861 20566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:26.577111 20566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:26.577240 20566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:26.584105 20566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:26.584199 20566 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:12:26.584265 20566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:26.584343 20566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:26.584408 20566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:26.584492 20566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:26.594015 20566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:42093
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:42093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:26.595194 20566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:26.596467 20566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:26.607447 20572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:26.607419 20575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:26.607630 20573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:26.608127 20566 server_base.cc:1034] running on GCE node
I20260810 03:12:26.608870 20566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:26.610100 20566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:26.611330 20566 hybrid_clock.cc:648] HybridClock initialized: now 1786331546611263 us; error 37 us; skew 500 ppm
I20260810 03:12:26.611665 20566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:26 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331546, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:26.614579 20566 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:26.615942 20566 webserver.cc:460] Webserver started at http://127.18.112.126:45717/ using document root <none> and password file <none>
I20260810 03:12:26.616569 20566 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:26.616668 20566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:26.616962 20566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:26.619686 20566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "9c714d53ac2d4d06a4dddaf093455cc1"
format_stamp: "Formatted at 2026-08-10 03:12:26 on dist-test-slave-jlzn"
server_key: "d830f0835dff2e6fd72dcd8ad3720eae"
server_key_iv: "5554fa4bb9bc5cf875ffbfd4b8b82f66"
server_key_version: "encryptionkey@0"
I20260810 03:12:26.620432 20566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "9c714d53ac2d4d06a4dddaf093455cc1"
format_stamp: "Formatted at 2026-08-10 03:12:26 on dist-test-slave-jlzn"
server_key: "d830f0835dff2e6fd72dcd8ad3720eae"
server_key_iv: "5554fa4bb9bc5cf875ffbfd4b8b82f66"
server_key_version: "encryptionkey@0"
I20260810 03:12:26.625090 20566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 03:12:26.628201 20583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:26.629360 20566 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260810 03:12:26.629534 20566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "9c714d53ac2d4d06a4dddaf093455cc1"
format_stamp: "Formatted at 2026-08-10 03:12:26 on dist-test-slave-jlzn"
server_key: "d830f0835dff2e6fd72dcd8ad3720eae"
server_key_iv: "5554fa4bb9bc5cf875ffbfd4b8b82f66"
server_key_version: "encryptionkey@0"
I20260810 03:12:26.629720 20566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:26.658738 20566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:26.662218 20566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:26.662451 20566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:26.682123 20566 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:42093
I20260810 03:12:26.682142 20673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:42093 every 8 connection(s)
I20260810 03:12:26.683394 20566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:26.686853 20674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:26.686918 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20566
I20260810 03:12:26.687135 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:26.687768 18881 external_mini_cluster.cc:1428] Setting key f21adaa977d50445fd07e7a0f9582484
I20260810 03:12:26.700169 20674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Bootstrap starting.
Aug 10 03:12:26 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:26.702942 20674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:26.704227 20674 log.cc:824] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:26.707270 20674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: No bootstrap required, opened a new log
I20260810 03:12:26.710979 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:26.689591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53670 (local address 127.18.112.126:42093)
0810 03:12:26.690413 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:26.690426 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:26.690473 (+ 47us) server_negotiation.cc:407] Connection header received
0810 03:12:26.692898 (+ 2425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:26.692925 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:26.693393 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:26.693803 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:26.694993 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:26.696969 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:26.698159 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:26.699154 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:26.699334 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:26.703040 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:26.703051 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:26.703068 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:26.703116 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:26.706760 (+ 3644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:26.707457 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:26.707465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:26.707472 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:26.707699 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:26.708050 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:26.708055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:26.708058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:26.708738 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:26.709029 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:26.709338 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 03:12:26.709739 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":331,"threads_started":1}
I20260810 03:12:26.716244 20674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } }
I20260810 03:12:26.716539 20674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:26.716609 20674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c714d53ac2d4d06a4dddaf093455cc1, State: Initialized, Role: FOLLOWER
I20260810 03:12:26.717090 20674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } }
I20260810 03:12:26.717310 20674 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:26.717404 20674 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:26.717519 20674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:26.719499 20674 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } }
I20260810 03:12:26.720044 20674 leader_election.cc:302] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c714d53ac2d4d06a4dddaf093455cc1; no voters:
I20260810 03:12:26.720536 20674 leader_election.cc:288] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:26.720649 20684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:26.721288 20684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 9c714d53ac2d4d06a4dddaf093455cc1, State: Running, Role: LEADER
I20260810 03:12:26.721777 20684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } }
I20260810 03:12:26.722306 20674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:26.724315 20689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c714d53ac2d4d06a4dddaf093455cc1. Latest consensus state: current_term: 1 leader_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } } }
I20260810 03:12:26.724695 20689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:26.728567 20687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c714d53ac2d4d06a4dddaf093455cc1" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42093 } } }
I20260810 03:12:26.728876 20687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:26.729038 20697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:26.733599 20697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:26.741024 20697 catalog_manager.cc:1347] Generated new cluster ID: 968b35082d0748a4a1df184995d78539
I20260810 03:12:26.741112 20697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:26.754347 20697 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:26.756028 20697 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:26.763679 20697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Generated new TSK 0
I20260810 03:12:26.764580 20697 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:26.811400 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42093
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:27.130532 20724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:27.130786 20724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:27.130879 20724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:27.137873 20724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:27.137974 20724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:27.138060 20724 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:27.138139 20724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:27.147475 20724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:42093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:27.148603 20724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:27.149832 20724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:27.162024 20738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:27.162132 20732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:27.162052 20733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:27.162683 20724 server_base.cc:1034] running on GCE node
I20260810 03:12:27.163230 20724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:27.164088 20724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:27.165299 20724 hybrid_clock.cc:648] HybridClock initialized: now 1786331547165244 us; error 26 us; skew 500 ppm
I20260810 03:12:27.165568 20724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:27 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331547, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:27.168511 20724 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:27.169833 20724 webserver.cc:460] Webserver started at http://127.18.112.65:43243/ using document root <none> and password file <none>
I20260810 03:12:27.170468 20724 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:27.170567 20724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:27.170867 20724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:27.173707 20724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "731bf4cd6d804e35bac385dae33e9ddf"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "014800c7e81f5a8af83fbb4682d71963"
server_key_iv: "e792d9e34c07a518c086f6e4fb1e54aa"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.174451 20724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "731bf4cd6d804e35bac385dae33e9ddf"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "014800c7e81f5a8af83fbb4682d71963"
server_key_iv: "e792d9e34c07a518c086f6e4fb1e54aa"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.179363 20724 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 03:12:27.182577 20750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:27.183732 20724 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:27.183893 20724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "731bf4cd6d804e35bac385dae33e9ddf"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "014800c7e81f5a8af83fbb4682d71963"
server_key_iv: "e792d9e34c07a518c086f6e4fb1e54aa"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.184087 20724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:27.206442 20724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:27.210189 20724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:27.210433 20724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:27.212965 20724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:27.213045 20724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:27.213194 20724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:27.213297 20724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 10 03:12:27 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331547, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:27.233850 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.213355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:51999 (local address 127.18.112.126:42093)
0810 03:12:27.213842 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:27.213848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:27.214987 (+ 1139us) server_negotiation.cc:407] Connection header received
0810 03:12:27.216971 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:27.216977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:27.217067 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:27.217194 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:27.219179 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.220127 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.222549 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.223161 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.223305 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.227883 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:27.227888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:27.227891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:27.227923 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:27.230501 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.231162 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.231166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.231168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.231286 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.231796 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.231821 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.231825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.232148 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:27.232291 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:27.233274 (+ 983us) server_negotiation.cc:299] Negotiation successful
0810 03:12:27.233450 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":224,"threads_started":1}
I20260810 03:12:27.235822 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.213977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.65:51999)
0810 03:12:27.214809 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:27.214864 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:27.216711 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:27.217475 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:27.217486 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:27.218175 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:27.218984 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.219024 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.220308 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.220314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.222418 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.222430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.223398 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.223411 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.223763 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.224512 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:27.224550 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:27.227591 (+ 3041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:27.230627 (+ 3036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.230642 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.230657 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.231046 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.231405 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.231409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.231413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.231688 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.232365 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:27.232373 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:27.232840 (+ 467us) client_negotiation.cc:769] Sending connection context
0810 03:12:27.234036 (+ 1196us) client_negotiation.cc:240] Negotiation successful
0810 03:12:27.234458 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":341,"threads_started":1}
I20260810 03:12:27.253497 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.241668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39365 (local address 127.18.112.126:42093)
0810 03:12:27.241836 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:27.241842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:27.241954 (+ 112us) server_negotiation.cc:407] Connection header received
0810 03:12:27.242113 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:27.242119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:27.242196 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:27.242271 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:27.243120 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.243903 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.245143 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.245547 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.245651 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.247493 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:27.247499 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:27.247504 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:27.247533 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:27.250374 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.251206 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.251210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.251212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.251348 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.251950 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.251955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.251958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.252237 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:27.252385 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:27.252932 (+ 547us) server_negotiation.cc:299] Negotiation successful
0810 03:12:27.253143 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:12:27.253587 20863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.241312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.65:39365)
0810 03:12:27.241867 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:27.241891 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:27.242009 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:27.242308 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:27.242313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:27.242735 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:27.242996 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.243004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.244022 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.244028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.245009 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.245020 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.245724 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.245730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.245875 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.246418 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:27.246433 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:27.247334 (+ 901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:27.250505 (+ 3171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.250510 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.250514 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.251056 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.251460 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.251467 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.251474 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.251676 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.252458 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:27.252463 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:27.252666 (+ 203us) client_negotiation.cc:769] Sending connection context
0810 03:12:27.252798 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 03:12:27.253128 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":400,"threads_started":1}
I20260810 03:12:27.263715 20724 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:41285
I20260810 03:12:27.263782 20927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:41285 every 8 connection(s)
I20260810 03:12:27.264972 20724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:27.266781 20928 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42093
I20260810 03:12:27.266980 20928 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:27.267580 20928 heartbeater.cc:511] Master 127.18.112.126:42093 requested a full tablet report, sending...
I20260810 03:12:27.269447 20607 ts_manager.cc:194] Registered new tserver with Master: 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285)
I20260810 03:12:27.270836 20607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:51999
I20260810 03:12:27.272025 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20724
I20260810 03:12:27.272225 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:27.272827 18881 external_mini_cluster.cc:1428] Setting key 2b622aedc23570a0d215916ca8fd3349
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:27.311949 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42093
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:27.623072 20933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:27.623343 20933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:27.623446 20933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:27.630403 20933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:27.630499 20933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:27.630585 20933 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:27.630664 20933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:27.640117 20933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:42093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:27.641242 20933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:27.642515 20933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:27.654790 20941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:27.654870 20948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:27.654829 20940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:27.655938 20933 server_base.cc:1034] running on GCE node
I20260810 03:12:27.656519 20933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:27.657343 20933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:27.658576 20933 hybrid_clock.cc:648] HybridClock initialized: now 1786331547658504 us; error 40 us; skew 500 ppm
I20260810 03:12:27.658847 20933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:27 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331547, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:27.665732 20933 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:27.667105 20933 webserver.cc:460] Webserver started at http://127.18.112.66:46847/ using document root <none> and password file <none>
I20260810 03:12:27.667749 20933 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:27.667878 20933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:27.668192 20933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:27.670877 20933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "e302973f27e540afbd5f8fbfb8740dad"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "d11d32f4f365ce632b64c200ec885530"
server_key_iv: "9161839553c6615ca47fc18339549297"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.671670 20933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "e302973f27e540afbd5f8fbfb8740dad"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "d11d32f4f365ce632b64c200ec885530"
server_key_iv: "9161839553c6615ca47fc18339549297"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.676503 20933 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:12:27.679661 20957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:27.680871 20933 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260810 03:12:27.681032 20933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "e302973f27e540afbd5f8fbfb8740dad"
format_stamp: "Formatted at 2026-08-10 03:12:27 on dist-test-slave-jlzn"
server_key: "d11d32f4f365ce632b64c200ec885530"
server_key_iv: "9161839553c6615ca47fc18339549297"
server_key_version: "encryptionkey@0"
I20260810 03:12:27.681223 20933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:27.698155 20933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:27.702018 20933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:27.702251 20933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:27.704747 20933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:27.704886 20933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:27.705031 20933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:27.705096 20933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:12:27 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331547, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:27.726442 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.705059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52347 (local address 127.18.112.126:42093)
0810 03:12:27.705269 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:27.705275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:27.706573 (+ 1298us) server_negotiation.cc:407] Connection header received
0810 03:12:27.708615 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:27.708621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:27.708709 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:27.708954 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:27.710943 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.712052 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.714797 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.715279 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.715392 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.719532 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:27.719539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:27.719544 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:27.719584 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:27.722706 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.723717 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.723723 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.723727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.723926 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.724492 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.724498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.724501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.724828 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:27.724979 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:27.725889 (+ 910us) server_negotiation.cc:299] Negotiation successful
0810 03:12:27.726100 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 03:12:27.727823 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.705519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.66:52347)
0810 03:12:27.706390 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:27.706445 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:27.708317 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:27.709272 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:27.709287 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:27.709951 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:27.710773 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.710802 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.712235 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.712241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.714640 (+ 2399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.714656 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.715510 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.715517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.715729 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.716336 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:27.716366 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:27.719296 (+ 2930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:27.722850 (+ 3554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.722859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.722878 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.723582 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.724039 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.724048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.724052 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.724322 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.725065 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:27.725070 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:27.725482 (+ 412us) client_negotiation.cc:769] Sending connection context
0810 03:12:27.725789 (+ 307us) client_negotiation.cc:240] Negotiation successful
0810 03:12:27.726292 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":345,"threads_started":1}
I20260810 03:12:27.745646 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.733353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.66:45817)
0810 03:12:27.733963 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:27.733985 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:27.734083 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:27.734371 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:27.734374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:27.734820 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:27.735105 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.735113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.736516 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.736521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.737626 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:27.737640 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.738683 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.738688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:27.738793 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.739292 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:27.739308 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:27.740042 (+ 734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:27.742972 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.742978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.742982 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.743543 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.744005 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:27.744011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:27.744017 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:27.744170 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:27.744876 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:27.744879 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:27.745024 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 03:12:27.745129 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:12:27.745340 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":330,"threads_started":1}
I20260810 03:12:27.745832 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:27.733315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:45817 (local address 127.18.112.126:42093)
0810 03:12:27.733523 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:27.733529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:27.734049 (+ 520us) server_negotiation.cc:407] Connection header received
0810 03:12:27.734180 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:27.734185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:27.734258 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:27.734366 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:27.735232 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.736361 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.737779 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:27.738511 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:27.738636 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:27.740225 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:27.740231 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:27.740236 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:27.740268 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:27.742849 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.743717 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.743722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.743725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.743910 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:27.744300 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:27.744307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:27.744311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:27.744762 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:27.744923 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:27.745236 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 03:12:27.745472 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:12:27.756790 20933 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:34865
I20260810 03:12:27.756857 21129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:34865 every 8 connection(s)
I20260810 03:12:27.757987 20933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:27.759968 21131 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42093
I20260810 03:12:27.760172 21131 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:27.760761 21131 heartbeater.cc:511] Master 127.18.112.126:42093 requested a full tablet report, sending...
I20260810 03:12:27.761978 20607 ts_manager.cc:194] Registered new tserver with Master: e302973f27e540afbd5f8fbfb8740dad (127.18.112.66:34865)
I20260810 03:12:27.762746 20607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:52347
I20260810 03:12:27.767841 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20933
I20260810 03:12:27.768002 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:27.768396 18881 external_mini_cluster.cc:1428] Setting key fb3718ded94fe449014ee82ac6a27f1a
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:27.806604 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42093
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:28.114307 21135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:28.114579 21135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:28.114733 21135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:28.121552 21135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:28.121665 21135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:28.121788 21135 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:28.121901 21135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:28.131204 21135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:42093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:28.132421 21135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:28.133716 21135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:28.145993 21140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:28.146021 21144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:28.145952 21141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:28.146728 21135 server_base.cc:1034] running on GCE node
I20260810 03:12:28.147274 21135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:28.148329 21135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:28.149555 21135 hybrid_clock.cc:648] HybridClock initialized: now 1786331548149495 us; error 27 us; skew 500 ppm
I20260810 03:12:28.149834 21135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:28 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:28.152892 21135 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:28.154264 21135 webserver.cc:460] Webserver started at http://127.18.112.67:39625/ using document root <none> and password file <none>
I20260810 03:12:28.154901 21135 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:28.154995 21135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:28.155303 21135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:28.158188 21135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "261ca6564eff45528f936864362217ff"
format_stamp: "Formatted at 2026-08-10 03:12:28 on dist-test-slave-jlzn"
server_key: "c12d56532ea3ba79280fc06161b85677"
server_key_iv: "304a9dd2ea00bded9554c240b6c81447"
server_key_version: "encryptionkey@0"
I20260810 03:12:28.159001 21135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "261ca6564eff45528f936864362217ff"
format_stamp: "Formatted at 2026-08-10 03:12:28 on dist-test-slave-jlzn"
server_key: "c12d56532ea3ba79280fc06161b85677"
server_key_iv: "304a9dd2ea00bded9554c240b6c81447"
server_key_version: "encryptionkey@0"
I20260810 03:12:28.163929 21135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260810 03:12:28.167165 21153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:28.168396 21135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:12:28.168542 21135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "261ca6564eff45528f936864362217ff"
format_stamp: "Formatted at 2026-08-10 03:12:28 on dist-test-slave-jlzn"
server_key: "c12d56532ea3ba79280fc06161b85677"
server_key_iv: "304a9dd2ea00bded9554c240b6c81447"
server_key_version: "encryptionkey@0"
I20260810 03:12:28.168736 21135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:28.200634 21135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:28.204664 21135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:28.204908 21135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:28.207389 21135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:28.207475 21135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:28.207681 21135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:28.207749 21135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:12:28 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:28.228814 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.207956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41191 (local address 127.18.112.126:42093)
0810 03:12:28.208228 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.208234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.209343 (+ 1109us) server_negotiation.cc:407] Connection header received
0810 03:12:28.211481 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.211487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.211588 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.211673 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:28.213680 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.214813 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.217105 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.217766 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.217900 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.221817 (+ 3917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:28.221825 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:28.221831 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:28.221875 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:28.225304 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.226252 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.226258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.226262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.226432 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.227003 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.227007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.227009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.227288 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:28.227397 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.228361 (+ 964us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.228563 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:12:28.230268 21167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.208297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.67:41191)
0810 03:12:28.209146 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.209193 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.211224 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.211989 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.212004 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.212676 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:28.213444 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.213466 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.214995 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.215004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.216976 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.216988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.218029 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.218041 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.218262 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.218854 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:28.218875 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:28.221570 (+ 2695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:28.225462 (+ 3892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.225471 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.225489 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.226083 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.226533 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.226538 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.226542 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.226850 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.227415 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:28.227424 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:28.227891 (+ 467us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.228244 (+ 353us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.228756 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":353,"threads_started":1}
I20260810 03:12:28.252151 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.235917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:36621 (local address 127.18.112.126:42093)
0810 03:12:28.236108 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.236113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.240473 (+ 4360us) server_negotiation.cc:407] Connection header received
0810 03:12:28.240661 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.240667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.240730 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.240803 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:28.241646 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.242327 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.243577 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.244126 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.244246 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.245977 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:28.245984 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:28.245988 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:28.246024 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:28.249196 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.250046 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.250050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.250053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.250202 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.250575 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.250581 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.250585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.250934 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:28.251093 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.251564 (+ 471us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.251767 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 03:12:28.252264 21255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.235903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.18.112.67:36621)
0810 03:12:28.240378 (+ 4475us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.240394 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.240553 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.240839 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.240843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.241245 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:28.241512 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.241520 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.242453 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.242459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.243451 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.243463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.244365 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.244376 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.244546 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.245121 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:28.245144 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:28.245814 (+ 670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:28.249332 (+ 3518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.249337 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.249340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.249887 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.250298 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.250306 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.250309 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.250454 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.251045 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:28.251051 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:28.251275 (+ 224us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.251428 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.251751 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4325,"thread_start_us":4142,"threads_started":1}
I20260810 03:12:28.259346 21135 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:35631
I20260810 03:12:28.259405 21326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:35631 every 8 connection(s)
I20260810 03:12:28.260488 21135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:28.261053 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21135
I20260810 03:12:28.261233 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:28.261795 18881 external_mini_cluster.cc:1428] Setting key eb077c79048990530225ea4b4b927c5d
I20260810 03:12:28.262419 21328 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42093
I20260810 03:12:28.262662 21328 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:28.263417 21328 heartbeater.cc:511] Master 127.18.112.126:42093 requested a full tablet report, sending...
I20260810 03:12:28.264832 20607 ts_manager.cc:194] Registered new tserver with Master: 261ca6564eff45528f936864362217ff (127.18.112.67:35631)
I20260810 03:12:28.265599 20607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:41191
I20260810 03:12:28.273412 20928 heartbeater.cc:503] Master 127.18.112.126:42093 was elected leader, sending a full tablet report...
I20260810 03:12:28.276549 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:12:28 dist-test-slave-jlzn krb5kdc[20547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:12:28 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:28.321092 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.308790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53686 (local address 127.18.112.126:42093)
0810 03:12:28.309030 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.309037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.309193 (+ 156us) server_negotiation.cc:407] Connection header received
0810 03:12:28.309354 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.309358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.309421 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.309495 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:28.310821 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.311542 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.312733 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.313127 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.313216 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.316584 (+ 3368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:28.316589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:28.316592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:28.316625 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:28.319017 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.319513 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.319517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.319519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.319640 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.319942 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.319945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.319947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.320208 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:28.320388 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.320573 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.320736 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 03:12:28.324772 20607 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:28.331511 20607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:28.353180 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.343076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.18.112.67:35631)
0810 03:12:28.345448 (+ 2372us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.345457 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.345488 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:12:28.345582 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.345590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.345853 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.346833 (+ 980us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:28.347165 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.348737 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.351014 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.352087 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.352213 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.352438 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.352679 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.352844 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2204,"thread_start_us":2851,"threads_started":1}
I20260810 03:12:28.353222 21349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.342913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:35631 (local address 127.0.0.1:39930)
0810 03:12:28.343651 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.343690 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.343901 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.346088 (+ 2187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.346097 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.346130 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:28.346573 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.346587 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.348869 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.348875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.350828 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.350842 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.352251 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.352257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.352434 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.352480 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.352605 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.352814 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":41,"thread_start_us":580,"threads_started":1}
I20260810 03:12:28.353756 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.343334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55196 (local address 127.18.112.65:41285)
0810 03:12:28.345656 (+ 2322us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.345664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.345687 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:12:28.345770 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.345777 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.345958 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.346257 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:28.347072 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.348355 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.350715 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.352201 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.352359 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.352558 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.353317 (+ 759us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.353481 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2183,"thread_start_us":2041,"threads_started":1}
I20260810 03:12:28.353845 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.343060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41285 (local address 127.0.0.1:55196)
0810 03:12:28.345062 (+ 2002us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.345079 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.345201 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.346252 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.346258 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.346292 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:28.346879 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.346893 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.348486 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.348491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.350475 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.350490 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.352706 (+ 2216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.352712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.352878 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.352910 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.352996 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.353107 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1855,"mutex_wait_us":69,"thread_start_us":1721,"threads_started":1}
I20260810 03:12:28.356010 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.345409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48550 (local address 127.18.112.66:34865)
0810 03:12:28.346024 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.346031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.347142 (+ 1111us) server_negotiation.cc:407] Connection header received
0810 03:12:28.347242 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.347250 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.347482 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.347726 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:28.348482 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.349705 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.352158 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.353721 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.354647 (+ 926us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.354827 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.355543 (+ 716us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.355707 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":348,"threads_started":1}
I20260810 03:12:28.356267 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.344803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34865 (local address 127.0.0.1:48550)
0810 03:12:28.346889 (+ 2086us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.346906 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.347016 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.347956 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.347961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.347986 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:28.348303 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.348314 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.349846 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.349851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.351975 (+ 2124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.351990 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.354133 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.354151 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.354319 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.354351 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.354921 (+ 570us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.355052 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1951,"mutex_wait_us":1,"thread_start_us":1775,"threads_started":1}
I20260810 03:12:28.356851 21225 tablet_service.cc:1467] Processing CreateTablet for tablet 4e613ccc97e04121ad962d690e02c49f (DEFAULT_TABLE table=test-table [id=be9e203c75a2452e89d29d8b7af3ec68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.357517 20830 tablet_service.cc:1467] Processing CreateTablet for tablet 4e613ccc97e04121ad962d690e02c49f (DEFAULT_TABLE table=test-table [id=be9e203c75a2452e89d29d8b7af3ec68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.358341 21225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e613ccc97e04121ad962d690e02c49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.358647 20830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e613ccc97e04121ad962d690e02c49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.359563 21031 tablet_service.cc:1467] Processing CreateTablet for tablet 4e613ccc97e04121ad962d690e02c49f (DEFAULT_TABLE table=test-table [id=be9e203c75a2452e89d29d8b7af3ec68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.360864 21031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e613ccc97e04121ad962d690e02c49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.369500 21360 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Bootstrap starting.
I20260810 03:12:28.372606 21361 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Bootstrap starting.
I20260810 03:12:28.373273 21360 tablet_bootstrap.cc:654] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.374589 21360 log.cc:824] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:28.374673 21362 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Bootstrap starting.
I20260810 03:12:28.376034 21361 tablet_bootstrap.cc:654] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.377260 21361 log.cc:824] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:28.377463 21362 tablet_bootstrap.cc:654] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.378166 21360 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: No bootstrap required, opened a new log
I20260810 03:12:28.378394 21360 ts_tablet_manager.cc:1397] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260810 03:12:28.378571 21362 log.cc:824] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:28.380182 21361 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: No bootstrap required, opened a new log
I20260810 03:12:28.380429 21361 ts_tablet_manager.cc:1397] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:12:28.380864 21362 tablet_bootstrap.cc:492] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: No bootstrap required, opened a new log
I20260810 03:12:28.381078 21362 ts_tablet_manager.cc:1397] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260810 03:12:28.388831 21362 raft_consensus.cc:348] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.388828 21360 raft_consensus.cc:348] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.389151 21362 raft_consensus.cc:374] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.389240 21360 raft_consensus.cc:374] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.389242 21362 raft_consensus.cc:729] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.389346 21360 raft_consensus.cc:729] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731bf4cd6d804e35bac385dae33e9ddf, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.389762 21362 consensus_queue.cc:260] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.389981 21360 consensus_queue.cc:260] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.390445 21361 raft_consensus.cc:348] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.390854 21361 raft_consensus.cc:374] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.390946 21361 raft_consensus.cc:729] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 261ca6564eff45528f936864362217ff, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.391063 21131 heartbeater.cc:503] Master 127.18.112.126:42093 was elected leader, sending a full tablet report...
I20260810 03:12:28.391613 21361 consensus_queue.cc:260] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.393123 21362 ts_tablet_manager.cc:1428] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260810 03:12:28.396687 21328 heartbeater.cc:503] Master 127.18.112.126:42093 was elected leader, sending a full tablet report...
I20260810 03:12:28.397305 21360 ts_tablet_manager.cc:1428] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Time spent starting tablet: real 0.019s user 0.013s sys 0.007s
I20260810 03:12:28.398245 21361 ts_tablet_manager.cc:1428] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Time spent starting tablet: real 0.018s user 0.009s sys 0.004s
W20260810 03:12:28.509843 21132 tablet.cc:2369] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:12:28.512050 21329 tablet.cc:2369] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:12:28.517168 20929 tablet.cc:2369] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:28.625439 21366 raft_consensus.cc:482] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:28.625772 21366 raft_consensus.cc:504] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.627506 21366 leader_election.cc:288] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 261ca6564eff45528f936864362217ff (127.18.112.67:35631), 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285)
I20260810 03:12:28.634877 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.627840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:46097 (local address 127.18.112.67:35631)
0810 03:12:28.628033 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.628040 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.628721 (+ 681us) server_negotiation.cc:407] Connection header received
0810 03:12:28.628898 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.628905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.628981 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.629066 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:28.629767 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.630569 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.632957 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.633812 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.633949 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.634024 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.634495 (+ 471us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.634625 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:12:28.634905 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.628035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:51047 (local address 127.18.112.65:41285)
0810 03:12:28.628240 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.628245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.628913 (+ 668us) server_negotiation.cc:407] Connection header received
0810 03:12:28.629067 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.629072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.629155 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.629257 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:28.629892 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.630656 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.632911 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.633834 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.633981 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.634051 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.634543 (+ 492us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.634679 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 03:12:28.635015 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.627766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:35631 (local address 127.18.112.66:46097)
0810 03:12:28.628607 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.628625 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.628750 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.629086 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.629091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.629112 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:28.629611 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.629634 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.630697 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.630702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.632824 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.632837 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.634160 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.634167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.634344 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.634368 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.634441 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.634550 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":76,"thread_start_us":403,"threads_started":1}
I20260810 03:12:28.635118 21373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.628003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41285 (local address 127.18.112.66:51047)
0810 03:12:28.628812 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.628829 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.628956 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.629283 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.629286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.629310 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:28.629745 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.629757 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.630789 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.630792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.632766 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.632782 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.634172 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.634177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.634385 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.634409 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.634500 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.634620 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":72,"thread_start_us":429,"threads_started":1}
I20260810 03:12:28.636196 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e613ccc97e04121ad962d690e02c49f" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff" is_pre_election: true
I20260810 03:12:28.636252 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e613ccc97e04121ad962d690e02c49f" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf" is_pre_election: true
I20260810 03:12:28.636682 21257 raft_consensus.cc:2454] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:28.636722 20865 raft_consensus.cc:2454] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:28.637286 20963 leader_election.cc:302] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 261ca6564eff45528f936864362217ff, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:28.637615 21366 raft_consensus.cc:2781] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:28.637748 21366 raft_consensus.cc:482] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:28.637844 21366 raft_consensus.cc:3037] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.640057 21366 raft_consensus.cc:504] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.640599 21366 leader_election.cc:288] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Requested vote from peers 261ca6564eff45528f936864362217ff (127.18.112.67:35631), 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285)
I20260810 03:12:28.641001 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e613ccc97e04121ad962d690e02c49f" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff"
I20260810 03:12:28.641024 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e613ccc97e04121ad962d690e02c49f" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf"
I20260810 03:12:28.641173 21257 raft_consensus.cc:3037] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.641182 20865 raft_consensus.cc:3037] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.643263 21257 raft_consensus.cc:2454] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:28.643431 20865 raft_consensus.cc:2454] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:28.643608 20963 leader_election.cc:302] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 261ca6564eff45528f936864362217ff, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:28.643956 21366 raft_consensus.cc:2781] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:28.644476 21366 raft_consensus.cc:686] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 1 LEADER]: Becoming Leader. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Running, Role: LEADER
I20260810 03:12:28.644912 21366 consensus_queue.cc:237] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } }
I20260810 03:12:28.649386 20605 catalog_manager.cc:5495] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad reported cstate change: term changed from 0 to 1, leader changed from <none> to e302973f27e540afbd5f8fbfb8740dad (127.18.112.66). New cstate: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } health_report { overall_health: HEALTHY } } }
I20260810 03:12:28.719826 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.714685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.18.112.66:34865)
0810 03:12:28.714874 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.714879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.714897 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:12:28.715200 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.715204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.715289 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.715406 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:28.715762 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.716504 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.717810 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.718209 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.718317 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.718773 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:28.719227 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:28.719352 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.719472 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.719551 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:12:28.727021 20865 raft_consensus.cc:1261] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Refusing update from remote peer e302973f27e540afbd5f8fbfb8740dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:28.727073 21257 raft_consensus.cc:1261] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Refusing update from remote peer e302973f27e540afbd5f8fbfb8740dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:28.727916 21374 consensus_queue.cc:1035] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:28.728237 21366 consensus_queue.cc:1035] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:28.737573 21378 mvcc.cc:205] Tried to move back new op lower bound from 7316814023577554944 to 7316814023253037056. Current Snapshot: MvccSnapshot[applied={T|T < 7316814023577554944}]
I20260810 03:12:28.748131 21379 mvcc.cc:205] Tried to move back new op lower bound from 7316814023577554944 to 7316814023253037056. Current Snapshot: MvccSnapshot[applied={T|T < 7316814023577554944}]
I20260810 03:12:28.755590 20607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:28.755996 20607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:28.759971 20607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Sending DeleteTablet for 3 replicas of tablet 4e613ccc97e04121ad962d690e02c49f
I20260810 03:12:28.761005 21225 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e613ccc97e04121ad962d690e02c49f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:28 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39930
I20260810 03:12:28.761291 20830 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e613ccc97e04121ad962d690e02c49f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:28 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55196
I20260810 03:12:28.762109 21031 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e613ccc97e04121ad962d690e02c49f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:28 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:48550
I20260810 03:12:28.764528 20607 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:28.765116 20607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:28.772109 21224 tablet_service.cc:1467] Processing CreateTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 (DEFAULT_TABLE table=test-table [id=ec6585fe9873418f816dc776a205ca76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.771981 20827 tablet_service.cc:1467] Processing CreateTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 (DEFAULT_TABLE table=test-table [id=ec6585fe9873418f816dc776a205ca76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.772523 21224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc66de1fd90e4c9c983d45c231e234a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.772751 20827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc66de1fd90e4c9c983d45c231e234a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.774121 21394 tablet_replica.cc:330] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: stopping tablet replica
I20260810 03:12:28.774665 21394 raft_consensus.cc:2229] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:28.775149 21394 raft_consensus.cc:2258] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:28.776569 21028 tablet_service.cc:1467] Processing CreateTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 (DEFAULT_TABLE table=test-table [id=ec6585fe9873418f816dc776a205ca76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:28.776968 21394 ts_tablet_manager.cc:1905] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:28.777196 21028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc66de1fd90e4c9c983d45c231e234a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.781767 21361 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Bootstrap starting.
I20260810 03:12:28.783291 21361 tablet_bootstrap.cc:654] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.786873 21360 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Bootstrap starting.
I20260810 03:12:28.786937 21362 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Bootstrap starting.
I20260810 03:12:28.787261 21394 ts_tablet_manager.cc:1918] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:28.787423 21394 log.cc:1196] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/4e613ccc97e04121ad962d690e02c49f
I20260810 03:12:28.788570 21360 tablet_bootstrap.cc:654] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.788642 21362 tablet_bootstrap.cc:654] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.789134 21394 ts_tablet_manager.cc:1939] T 4e613ccc97e04121ad962d690e02c49f P 261ca6564eff45528f936864362217ff: Deleting consensus metadata
I20260810 03:12:28.791009 20587 catalog_manager.cc:4841] TS 261ca6564eff45528f936864362217ff (127.18.112.67:35631): tablet 4e613ccc97e04121ad962d690e02c49f (table test-table [id=be9e203c75a2452e89d29d8b7af3ec68]) successfully deleted
I20260810 03:12:28.792521 21398 tablet_replica.cc:330] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: stopping tablet replica
I20260810 03:12:28.792927 21398 raft_consensus.cc:2229] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:28.793637 21398 raft_consensus.cc:2258] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:28.794374 21397 tablet_replica.cc:330] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: stopping tablet replica
I20260810 03:12:28.794745 21397 raft_consensus.cc:2229] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:28.795188 21397 raft_consensus.cc:2258] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:28.796736 21398 ts_tablet_manager.cc:1905] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:28.797142 21397 ts_tablet_manager.cc:1905] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:28.802597 21362 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: No bootstrap required, opened a new log
I20260810 03:12:28.802757 21362 ts_tablet_manager.cc:1397] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
I20260810 03:12:28.803603 21362 raft_consensus.cc:348] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.803854 21362 raft_consensus.cc:374] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.803959 21362 raft_consensus.cc:729] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.804256 21362 consensus_queue.cc:260] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.804822 21362 ts_tablet_manager.cc:1428] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:28.808840 21397 ts_tablet_manager.cc:1918] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:28.809005 21397 log.cc:1196] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/4e613ccc97e04121ad962d690e02c49f
I20260810 03:12:28.809590 21397 ts_tablet_manager.cc:1939] T 4e613ccc97e04121ad962d690e02c49f P 731bf4cd6d804e35bac385dae33e9ddf: Deleting consensus metadata
I20260810 03:12:28.809612 21398 ts_tablet_manager.cc:1918] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:28.809736 21360 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: No bootstrap required, opened a new log
I20260810 03:12:28.809885 21360 ts_tablet_manager.cc:1397] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.002s
I20260810 03:12:28.809908 21398 log.cc:1196] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/4e613ccc97e04121ad962d690e02c49f
I20260810 03:12:28.810530 21398 ts_tablet_manager.cc:1939] T 4e613ccc97e04121ad962d690e02c49f P e302973f27e540afbd5f8fbfb8740dad: Deleting consensus metadata
I20260810 03:12:28.810930 21360 raft_consensus.cc:348] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.811163 21360 raft_consensus.cc:374] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.811275 21360 raft_consensus.cc:729] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731bf4cd6d804e35bac385dae33e9ddf, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.811599 21360 consensus_queue.cc:260] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.811775 20585 catalog_manager.cc:4841] TS 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285): tablet 4e613ccc97e04121ad962d690e02c49f (table test-table [id=be9e203c75a2452e89d29d8b7af3ec68]) successfully deleted
I20260810 03:12:28.812191 21360 ts_tablet_manager.cc:1428] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:28.812739 20584 catalog_manager.cc:4841] TS e302973f27e540afbd5f8fbfb8740dad (127.18.112.66:34865): tablet 4e613ccc97e04121ad962d690e02c49f (table test-table [id=be9e203c75a2452e89d29d8b7af3ec68]) successfully deleted
I20260810 03:12:28.813498 21361 tablet_bootstrap.cc:492] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: No bootstrap required, opened a new log
I20260810 03:12:28.813643 21361 ts_tablet_manager.cc:1397] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.012s
I20260810 03:12:28.814393 21361 raft_consensus.cc:348] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.814589 21361 raft_consensus.cc:374] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.814692 21361 raft_consensus.cc:729] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 261ca6564eff45528f936864362217ff, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.814937 21361 consensus_queue.cc:260] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.816007 21361 ts_tablet_manager.cc:1428] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 03:12:28.841955 21386 raft_consensus.cc:482] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:28.842145 21386 raft_consensus.cc:504] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.842917 21386 leader_election.cc:288] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285), 261ca6564eff45528f936864362217ff (127.18.112.67:35631)
I20260810 03:12:28.843364 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc66de1fd90e4c9c983d45c231e234a7" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf" is_pre_election: true
I20260810 03:12:28.843438 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc66de1fd90e4c9c983d45c231e234a7" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff" is_pre_election: true
I20260810 03:12:28.843602 20865 raft_consensus.cc:2454] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:28.843637 21257 raft_consensus.cc:2454] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:28.844039 20963 leader_election.cc:302] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 261ca6564eff45528f936864362217ff, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:28.844286 21386 raft_consensus.cc:2781] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:28.844403 21386 raft_consensus.cc:482] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:28.844537 21386 raft_consensus.cc:3037] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.846786 21386 raft_consensus.cc:504] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.847361 21386 leader_election.cc:288] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Requested vote from peers 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285), 261ca6564eff45528f936864362217ff (127.18.112.67:35631)
I20260810 03:12:28.847718 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc66de1fd90e4c9c983d45c231e234a7" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf"
I20260810 03:12:28.847995 20865 raft_consensus.cc:3037] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.847934 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc66de1fd90e4c9c983d45c231e234a7" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff"
I20260810 03:12:28.848122 21257 raft_consensus.cc:3037] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:28.850064 21257 raft_consensus.cc:2454] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:28.850406 20963 leader_election.cc:302] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 261ca6564eff45528f936864362217ff, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:28.850693 21386 raft_consensus.cc:2781] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:28.850843 21386 raft_consensus.cc:686] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 1 LEADER]: Becoming Leader. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Running, Role: LEADER
I20260810 03:12:28.851186 21386 consensus_queue.cc:237] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.851316 20865 raft_consensus.cc:2454] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:28.853787 20605 catalog_manager.cc:5495] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad reported cstate change: term changed from 0 to 1, leader changed from <none> to e302973f27e540afbd5f8fbfb8740dad (127.18.112.66). New cstate: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } health_report { overall_health: UNKNOWN } } }
Aug 10 03:12:28 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331546, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:28.908195 21409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.894014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53698 (local address 127.18.112.126:42093)
0810 03:12:28.894617 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:28.894626 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:28.894954 (+ 328us) server_negotiation.cc:407] Connection header received
0810 03:12:28.895096 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:28.895101 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:28.895180 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:28.895300 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:28.896359 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.897512 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.898704 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.899369 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.899496 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.902867 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:28.902872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:28.902875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:28.902902 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:28.905448 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.906296 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.906300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.906302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.906423 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:28.906821 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:28.906824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:28.906826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:28.907161 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:28.907266 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:28.907731 (+ 465us) server_negotiation.cc:299] Negotiation successful
0810 03:12:28.907921 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":448,"thread_start_us":297,"threads_started":1}
I20260810 03:12:28.908550 21410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:28.894014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42093 (local address 127.0.0.1:53698)
0810 03:12:28.894866 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:28.894883 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:28.894998 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:28.895317 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:28.895320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:28.896016 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:28.896215 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.896224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.897646 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.897650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.898574 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:28.898584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:28.899512 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:28.899516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:28.899656 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:28.900282 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:28.900299 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:28.902695 (+ 2396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:28.905581 (+ 2886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.905594 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.905602 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.906195 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.906520 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:28.906525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:28.906529 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:28.906722 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:28.907282 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:28.907291 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:28.907479 (+ 188us) client_negotiation.cc:769] Sending connection context
0810 03:12:28.907668 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 03:12:28.908092 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"mutex_wait_us":140,"thread_start_us":566,"threads_started":1}
I20260810 03:12:28.913812 20605 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:53698:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:12:28.915020 20605 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:28.921440 20830 tablet_service.cc:1467] Processing CreateTablet for tablet e2d9c870098a4a608f2e9ddb85b6368c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0e10159548a44350aa2da0121dcbfb7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:28.921552 21031 tablet_service.cc:1467] Processing CreateTablet for tablet e2d9c870098a4a608f2e9ddb85b6368c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0e10159548a44350aa2da0121dcbfb7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:28.921736 21224 tablet_service.cc:1467] Processing CreateTablet for tablet e2d9c870098a4a608f2e9ddb85b6368c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0e10159548a44350aa2da0121dcbfb7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:28.922036 20830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d9c870098a4a608f2e9ddb85b6368c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.922148 21031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d9c870098a4a608f2e9ddb85b6368c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.922223 21224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d9c870098a4a608f2e9ddb85b6368c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:28.929229 21360 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: Bootstrap starting.
I20260810 03:12:28.929311 21362 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: Bootstrap starting.
I20260810 03:12:28.930904 21361 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: Bootstrap starting.
I20260810 03:12:28.930949 21360 tablet_bootstrap.cc:654] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.932521 21361 tablet_bootstrap.cc:654] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.933663 21362 tablet_bootstrap.cc:654] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:28.934173 21360 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: No bootstrap required, opened a new log
I20260810 03:12:28.934444 21360 ts_tablet_manager.cc:1397] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260810 03:12:28.935225 21360 raft_consensus.cc:348] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.935468 21360 raft_consensus.cc:374] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.935551 21360 raft_consensus.cc:729] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731bf4cd6d804e35bac385dae33e9ddf, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.935781 21360 consensus_queue.cc:260] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.936421 21360 ts_tablet_manager.cc:1428] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:28.936244 21367 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:28.936627 21367 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:28.938107 21361 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: No bootstrap required, opened a new log
I20260810 03:12:28.938169 21362 tablet_bootstrap.cc:492] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: No bootstrap required, opened a new log
I20260810 03:12:28.938334 21362 ts_tablet_manager.cc:1397] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 03:12:28.938334 21361 ts_tablet_manager.cc:1397] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260810 03:12:28.939005 21361 raft_consensus.cc:348] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.939117 21362 raft_consensus.cc:348] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.939241 21361 raft_consensus.cc:374] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.939322 21361 raft_consensus.cc:729] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 261ca6564eff45528f936864362217ff, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.939368 21362 raft_consensus.cc:374] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:28.939548 21362 raft_consensus.cc:729] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Initialized, Role: FOLLOWER
I20260810 03:12:28.939553 21361 consensus_queue.cc:260] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.939870 21362 consensus_queue.cc:260] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:28.940013 21369 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:28.940320 21369 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:28.940310 21386 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:28.940590 21386 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:28.941190 21361 ts_tablet_manager.cc:1428] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:12:28.942780 21362 ts_tablet_manager.cc:1428] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 03:12:29.211789 21386 raft_consensus.cc:482] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:29.212029 21386 raft_consensus.cc:504] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:29.212682 21386 leader_election.cc:288] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285), 261ca6564eff45528f936864362217ff (127.18.112.67:35631)
I20260810 03:12:29.213222 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d9c870098a4a608f2e9ddb85b6368c" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff" is_pre_election: true
I20260810 03:12:29.213212 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d9c870098a4a608f2e9ddb85b6368c" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf" is_pre_election: true
I20260810 03:12:29.213460 21257 raft_consensus.cc:2454] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:29.213466 20865 raft_consensus.cc:2454] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 0.
I20260810 03:12:29.213887 20960 leader_election.cc:302] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 261ca6564eff45528f936864362217ff, 731bf4cd6d804e35bac385dae33e9ddf, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:29.214283 21386 raft_consensus.cc:2781] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:29.214367 21386 raft_consensus.cc:482] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:29.214457 21386 raft_consensus.cc:3037] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:29.216478 21386 raft_consensus.cc:504] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:29.217005 21386 leader_election.cc:288] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Requested vote from peers 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285), 261ca6564eff45528f936864362217ff (127.18.112.67:35631)
I20260810 03:12:29.217362 20865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d9c870098a4a608f2e9ddb85b6368c" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731bf4cd6d804e35bac385dae33e9ddf"
I20260810 03:12:29.217434 21257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d9c870098a4a608f2e9ddb85b6368c" candidate_uuid: "e302973f27e540afbd5f8fbfb8740dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261ca6564eff45528f936864362217ff"
I20260810 03:12:29.217576 20865 raft_consensus.cc:3037] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:29.217645 21257 raft_consensus.cc:3037] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:29.220468 20865 raft_consensus.cc:2454] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:29.220551 21257 raft_consensus.cc:2454] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e302973f27e540afbd5f8fbfb8740dad in term 1.
I20260810 03:12:29.220889 20960 leader_election.cc:302] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 731bf4cd6d804e35bac385dae33e9ddf, e302973f27e540afbd5f8fbfb8740dad; no voters:
I20260810 03:12:29.221127 21386 raft_consensus.cc:2781] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:29.221278 21386 raft_consensus.cc:686] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [term 1 LEADER]: Becoming Leader. State: Replica: e302973f27e540afbd5f8fbfb8740dad, State: Running, Role: LEADER
I20260810 03:12:29.221517 21386 consensus_queue.cc:237] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } }
I20260810 03:12:29.222934 21374 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: TxnStatusTablet state changed. Reason: New leader e302973f27e540afbd5f8fbfb8740dad. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.223184 21374 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:29.223749 21417 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:12:29.224000 21417 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:12:29.224493 20604 catalog_manager.cc:5495] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad reported cstate change: term changed from 0 to 1, leader changed from <none> to e302973f27e540afbd5f8fbfb8740dad (127.18.112.66). New cstate: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } health_report { overall_health: UNKNOWN } } }
I20260810 03:12:29.276199 21386 consensus_queue.cc:1035] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:29.292985 21386 consensus_queue.cc:1035] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:29.312301 21410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.306114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34865 (local address 127.0.0.1:48564)
0810 03:12:29.306344 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:29.306366 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:29.306520 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:29.307334 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:29.307339 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:29.307352 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:29.307549 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:29.307559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.309032 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.309036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:29.310159 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:29.310171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.311113 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.311117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:29.311261 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.311314 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:29.311756 (+ 442us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:29.311774 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 03:12:29.311872 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 03:12:29.312016 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 03:12:29.312340 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.305700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48564 (local address 127.18.112.66:34865)
0810 03:12:29.306144 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.306150 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.306441 (+ 291us) server_negotiation.cc:407] Connection header received
0810 03:12:29.306724 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.306730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.306809 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.306911 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:29.307723 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.308911 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.310294 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.310990 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.311116 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.311505 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:29.311658 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:29.311743 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.311902 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.311979 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":224,"threads_started":1}
I20260810 03:12:29.315413 21257 raft_consensus.cc:1261] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Refusing update from remote peer e302973f27e540afbd5f8fbfb8740dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:29.315464 20864 raft_consensus.cc:1261] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Refusing update from remote peer e302973f27e540afbd5f8fbfb8740dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:29.315989 21425 consensus_queue.cc:1035] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:29.316310 21374 consensus_queue.cc:1035] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:29.318451 21369 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: TxnStatusTablet state changed. Reason: New leader e302973f27e540afbd5f8fbfb8740dad. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.318727 21369 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:29.325032 21367 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: TxnStatusTablet state changed. Reason: New leader e302973f27e540afbd5f8fbfb8740dad. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.325328 21367 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:29.327919 21369 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.328141 21369 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 261ca6564eff45528f936864362217ff: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:29.330422 21425 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.331180 21425 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:29.330909 21374 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.332468 21374 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P e302973f27e540afbd5f8fbfb8740dad: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:29.335397 21367 tablet_replica.cc:439] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e302973f27e540afbd5f8fbfb8740dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "731bf4cd6d804e35bac385dae33e9ddf" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41285 } } peers { permanent_uuid: "e302973f27e540afbd5f8fbfb8740dad" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34865 } } peers { permanent_uuid: "261ca6564eff45528f936864362217ff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35631 } } }
I20260810 03:12:29.335630 21367 tablet_replica.cc:442] T e2d9c870098a4a608f2e9ddb85b6368c P 731bf4cd6d804e35bac385dae33e9ddf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:29.361759 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.355850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:36921 (local address 127.18.112.66:34865)
0810 03:12:29.355995 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.355999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.356411 (+ 412us) server_negotiation.cc:407] Connection header received
0810 03:12:29.356594 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.356600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.356664 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.356734 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:29.357321 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.358061 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.360118 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.360538 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.360642 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.361047 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:29.361154 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:29.361224 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.361343 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.361410 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":33}
I20260810 03:12:29.361847 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.355485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34865 (local address 127.18.112.66:36921)
0810 03:12:29.356305 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:29.356330 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:29.356488 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:29.356774 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:29.356783 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:29.356795 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:29.357161 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:29.357174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.358192 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.358197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:29.359988 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:29.360003 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.360719 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.360724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:29.360850 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.360903 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:29.361241 (+ 338us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:29.361252 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 03:12:29.361318 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:12:29.361440 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":510,"threads_started":1}
I20260810 03:12:29.416139 20607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:29.416392 20607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:29.419289 20607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c714d53ac2d4d06a4dddaf093455cc1: Sending DeleteTablet for 3 replicas of tablet bc66de1fd90e4c9c983d45c231e234a7
I20260810 03:12:29.419950 20830 tablet_service.cc:1514] Processing DeleteTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:29 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55196
I20260810 03:12:29.420076 21028 tablet_service.cc:1514] Processing DeleteTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:29 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:48550
I20260810 03:12:29.420416 21224 tablet_service.cc:1514] Processing DeleteTablet for tablet bc66de1fd90e4c9c983d45c231e234a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:29 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39930
I20260810 03:12:29.431069 21453 tablet_replica.cc:330] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: stopping tablet replica
I20260810 03:12:29.431416 21453 raft_consensus.cc:2229] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:29.432045 21453 raft_consensus.cc:2258] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:29.433351 21453 ts_tablet_manager.cc:1905] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:29.441082 21453 ts_tablet_manager.cc:1918] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:29.441284 21453 log.cc:1196] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/bc66de1fd90e4c9c983d45c231e234a7
I20260810 03:12:29.441792 21455 tablet_replica.cc:330] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: stopping tablet replica
I20260810 03:12:29.442353 21453 ts_tablet_manager.cc:1939] T bc66de1fd90e4c9c983d45c231e234a7 P e302973f27e540afbd5f8fbfb8740dad: Deleting consensus metadata
I20260810 03:12:29.443396 21455 raft_consensus.cc:2229] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:29.443445 20584 catalog_manager.cc:4841] TS e302973f27e540afbd5f8fbfb8740dad (127.18.112.66:34865): tablet bc66de1fd90e4c9c983d45c231e234a7 (table test-table [id=ec6585fe9873418f816dc776a205ca76]) successfully deleted
I20260810 03:12:29.444217 21455 raft_consensus.cc:2258] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:29.444722 21452 tablet_replica.cc:330] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: stopping tablet replica
I20260810 03:12:29.444864 21452 raft_consensus.cc:2229] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:29.445021 21452 raft_consensus.cc:2258] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:29.445629 21455 ts_tablet_manager.cc:1905] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:29.445964 21452 ts_tablet_manager.cc:1905] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:29.450038 21455 ts_tablet_manager.cc:1918] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:29.450173 21455 log.cc:1196] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/bc66de1fd90e4c9c983d45c231e234a7
I20260810 03:12:29.450601 21455 ts_tablet_manager.cc:1939] T bc66de1fd90e4c9c983d45c231e234a7 P 261ca6564eff45528f936864362217ff: Deleting consensus metadata
I20260810 03:12:29.451593 20587 catalog_manager.cc:4841] TS 261ca6564eff45528f936864362217ff (127.18.112.67:35631): tablet bc66de1fd90e4c9c983d45c231e234a7 (table test-table [id=ec6585fe9873418f816dc776a205ca76]) successfully deleted
I20260810 03:12:29.452412 21452 ts_tablet_manager.cc:1918] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:29.452893 21452 log.cc:1196] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/bc66de1fd90e4c9c983d45c231e234a7
I20260810 03:12:29.453384 21452 ts_tablet_manager.cc:1939] T bc66de1fd90e4c9c983d45c231e234a7 P 731bf4cd6d804e35bac385dae33e9ddf: Deleting consensus metadata
I20260810 03:12:29.454347 20585 catalog_manager.cc:4841] TS 731bf4cd6d804e35bac385dae33e9ddf (127.18.112.65:41285): tablet bc66de1fd90e4c9c983d45c231e234a7 (table test-table [id=ec6585fe9873418f816dc776a205ca76]) successfully deleted
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:29.466933 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.442947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.18.112.65:41285)
0810 03:12:29.444009 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.444016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.450750 (+ 6734us) server_negotiation.cc:407] Connection header received
0810 03:12:29.451030 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.451036 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.451126 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.451206 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:29.453066 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.453885 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.455234 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.455644 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.455752 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.459775 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:29.459786 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:29.459830 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:29.459871 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:29.463770 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.464604 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.464614 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.464617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.464782 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.465172 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.465177 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.465180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.465586 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:29.465922 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.466353 (+ 431us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.466569 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":941,"thread_start_us":844,"threads_started":1}
W20260810 03:12:29.467857 20919 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55200
I20260810 03:12:29.503391 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.472904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53708 (local address 127.18.112.126:42093)
0810 03:12:29.486005 (+ 13101us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.486011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.486031 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:12:29.486096 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.486102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.486195 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.486321 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:29.488144 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.489470 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.491303 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.491976 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.492090 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.495165 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:29.495171 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:29.495176 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:29.495219 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:29.498806 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.500016 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.500023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.500027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.500197 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.500716 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.500722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.500725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.501078 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:29.501332 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.502074 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.502663 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12953,"thread_start_us":13508,"threads_started":1}
W20260810 03:12:29.504050 20607 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53708
I20260810 03:12:29.505906 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20724
I20260810 03:12:29.521211 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.507345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55204 (local address 127.18.112.65:41285)
0810 03:12:29.507544 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.507550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.507793 (+ 243us) server_negotiation.cc:407] Connection header received
0810 03:12:29.508117 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.508123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.508212 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.508282 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:29.509845 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.510895 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.512698 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.513387 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.513484 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.516305 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:29.516309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:29.516313 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:29.516344 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:29.518764 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.519565 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.519568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.519570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.519686 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.520089 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.520092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.520094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.520330 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:29.520513 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.520815 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.520975 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 03:12:29.521842 20919 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55204
W20260810 03:12:29.522416 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20724: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:29.522574 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20724
I20260810 03:12:29.550490 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20933
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:29.565586 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.551252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48578 (local address 127.18.112.66:34865)
0810 03:12:29.551456 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.551461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.551482 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:12:29.551621 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.551625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.551686 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.551764 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:29.552948 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.553742 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.554958 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.555403 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.555518 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.559597 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:29.559610 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:29.559629 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:29.559668 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:29.562676 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.563304 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.563311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.563313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.563458 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.564025 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.564029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.564031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.564404 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:29.564724 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.565006 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.565226 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 03:12:29.566275 21118 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48578
W20260810 03:12:29.566918 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20933: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:29.567093 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20933
I20260810 03:12:29.597144 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21135
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[20547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:29.611506 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:29.597875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39942 (local address 127.18.112.67:35631)
0810 03:12:29.598378 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:29.598383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:29.598397 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:12:29.598447 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:29.598451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:29.598508 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:29.598610 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:29.599850 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.600609 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.601805 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:29.602230 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:29.602337 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:29.606165 (+ 3828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:29.606178 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:29.606194 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:29.606226 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:29.608935 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.609547 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.609556 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.609558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.609704 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:29.610058 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:29.610062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:29.610064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:29.610400 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:29.610678 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:29.610962 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 03:12:29.611182 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":252,"threads_started":1}
W20260810 03:12:29.612355 21321 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39942
W20260810 03:12:29.612932 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21135: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:29.613051 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21135
I20260810 03:12:29.634742 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20566
I20260810 03:12:29.635762 20669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:29.747161 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20566
2026-08-10T03:12:29Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4800 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[21470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[21470](info): set up 2 sockets
Aug 10 03:12:29 dist-test-slave-jlzn krb5kdc[21470](info): commencing operation
krb5kdc: starting...
W20260810 03:12:30.942106 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.002s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260810 03:12:31.100092 18881 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.158s user 0.001s sys 0.005s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260810 03:12:31.232833 18881 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.133s user 0.001s sys 0.005s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260810 03:12:31.395790 18881 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.163s user 0.001s sys 0.005s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/test-user.keytab.
W20260810 03:12:31.958408 18881 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.562s user 0.003s sys 0.003s
Aug 10 03:12:31 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
W20260810 03:12:32.315048 18881 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.112.126: real 0.309s user 0.003s sys 0.007s
I20260810 03:12:32.316184 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44491
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:32.631068 21487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:32.631328 21487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:32.631423 21487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:32.638377 21487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:32.638468 21487 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:12:32.638515 21487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:32.638581 21487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:32.638629 21487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:32.638687 21487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:32.647926 21487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44491
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:32.648981 21487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:32.650169 21487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:32.661284 21494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:32.661262 21495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:32.661360 21500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:32.662266 21487 server_base.cc:1034] running on GCE node
I20260810 03:12:32.662967 21487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:32.664222 21487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:32.665427 21487 hybrid_clock.cc:648] HybridClock initialized: now 1786331552665397 us; error 69 us; skew 500 ppm
I20260810 03:12:32.665707 21487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:32 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331552, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:32.671195 21487 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:32.672508 21487 webserver.cc:460] Webserver started at http://127.18.112.126:44871/ using document root <none> and password file <none>
I20260810 03:12:32.673122 21487 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:32.673234 21487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:32.673522 21487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:32.676308 21487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "162b897a217d43f38ccb0def31f281d4"
format_stamp: "Formatted at 2026-08-10 03:12:32 on dist-test-slave-jlzn"
server_key: "34b18f602dedb438a3f23b4e11803121"
server_key_iv: "745cda8f361482873b5b09e6a9c2bc80"
server_key_version: "encryptionkey@0"
I20260810 03:12:32.677016 21487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "162b897a217d43f38ccb0def31f281d4"
format_stamp: "Formatted at 2026-08-10 03:12:32 on dist-test-slave-jlzn"
server_key: "34b18f602dedb438a3f23b4e11803121"
server_key_iv: "745cda8f361482873b5b09e6a9c2bc80"
server_key_version: "encryptionkey@0"
I20260810 03:12:32.681663 21487 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:32.684852 21509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:32.686007 21487 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:32.686161 21487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "162b897a217d43f38ccb0def31f281d4"
format_stamp: "Formatted at 2026-08-10 03:12:32 on dist-test-slave-jlzn"
server_key: "34b18f602dedb438a3f23b4e11803121"
server_key_iv: "745cda8f361482873b5b09e6a9c2bc80"
server_key_version: "encryptionkey@0"
I20260810 03:12:32.686349 21487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:32.698436 21487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:32.701928 21487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:32.702167 21487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:32.721036 21487 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44491
I20260810 03:12:32.721038 21605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44491 every 8 connection(s)
I20260810 03:12:32.722287 21487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:32.723470 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21487
I20260810 03:12:32.723697 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:32.724542 18881 external_mini_cluster.cc:1428] Setting key 1e9ba54a07c79e1289d811643baa1b0b
I20260810 03:12:32.726712 21606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 03:12:32 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:32.739220 21606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Bootstrap starting.
I20260810 03:12:32.742200 21606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:32.743168 21606 log.cc:824] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:32.745846 21606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: No bootstrap required, opened a new log
I20260810 03:12:32.746083 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:32.726467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49330 (local address 127.18.112.126:44491)
0810 03:12:32.727174 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:32.727185 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:32.727223 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:12:32.728813 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:32.728834 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:32.729194 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:32.729509 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:32.731238 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:32.732597 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:32.734283 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:32.734906 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:32.735033 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:32.739452 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:32.739461 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:32.739473 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:32.739512 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:32.742319 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:32.742968 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:32.742975 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:32.742980 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:32.743155 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:32.743520 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:32.743524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:32.743525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:32.744084 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:32.744370 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:32.744786 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 03:12:32.745158 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":314,"threads_started":1}
I20260810 03:12:32.753264 21606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } }
I20260810 03:12:32.753590 21606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:32.753679 21606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162b897a217d43f38ccb0def31f281d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:32.754220 21606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } }
I20260810 03:12:32.754433 21606 raft_consensus.cc:388] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:32.754554 21606 raft_consensus.cc:482] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:32.754702 21606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:32.756961 21606 raft_consensus.cc:504] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } }
I20260810 03:12:32.757418 21606 leader_election.cc:302] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 162b897a217d43f38ccb0def31f281d4; no voters:
I20260810 03:12:32.757913 21606 leader_election.cc:288] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:32.758019 21614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:32.758638 21614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [term 1 LEADER]: Becoming Leader. State: Replica: 162b897a217d43f38ccb0def31f281d4, State: Running, Role: LEADER
I20260810 03:12:32.759127 21614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } }
I20260810 03:12:32.759747 21606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:32.761994 21615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "162b897a217d43f38ccb0def31f281d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } } }
I20260810 03:12:32.763209 21615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:32.762032 21616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 162b897a217d43f38ccb0def31f281d4. Latest consensus state: current_term: 1 leader_uuid: "162b897a217d43f38ccb0def31f281d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "162b897a217d43f38ccb0def31f281d4" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44491 } } }
I20260810 03:12:32.763456 21616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:32.764343 21626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:32.769320 21626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:32.778244 21626 catalog_manager.cc:1347] Generated new cluster ID: a1097cd9786c47338bbecc05ddefdbbd
I20260810 03:12:32.778331 21626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:32.795600 21626 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:32.796881 21626 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:32.804783 21626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Generated new TSK 0
I20260810 03:12:32.805488 21626 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:32.854904 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44491
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:33.166759 21645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:33.167008 21645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:33.167145 21645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:33.174108 21645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:33.174201 21645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:33.174321 21645 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:12:33.174384 21645 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:33.174484 21645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:33.183553 21645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:33.184828 21645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:33.186084 21645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:33.198127 21651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:33.198217 21650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:33.198637 21653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:33.198884 21645 server_base.cc:1034] running on GCE node
I20260810 03:12:33.199450 21645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:33.200383 21645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:33.201589 21645 hybrid_clock.cc:648] HybridClock initialized: now 1786331553201545 us; error 34 us; skew 500 ppm
I20260810 03:12:33.201874 21645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:33 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331553, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:33.204978 21645 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:33.206326 21645 webserver.cc:460] Webserver started at http://127.18.112.65:46135/ using document root <none> and password file <none>
I20260810 03:12:33.206924 21645 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:33.207024 21645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:33.207274 21645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:33.210055 21645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "23388793216f41af9beb944f3ff800d4"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "8287449ef77bbb04a1388a2452645fde"
server_key_iv: "192edc8124489b6ac0d1f496b5166d4a"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.210772 21645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "23388793216f41af9beb944f3ff800d4"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "8287449ef77bbb04a1388a2452645fde"
server_key_iv: "192edc8124489b6ac0d1f496b5166d4a"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.215539 21645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 03:12:33.218896 21666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:33.220134 21645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:12:33.220261 21645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "23388793216f41af9beb944f3ff800d4"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "8287449ef77bbb04a1388a2452645fde"
server_key_iv: "192edc8124489b6ac0d1f496b5166d4a"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.220412 21645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:33.234803 21645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:33.238293 21645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:33.238517 21645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:33.240907 21645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:33.240996 21645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:33.241128 21645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:33.241196 21645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:12:33 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331553, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:33.262914 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.241504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:44069 (local address 127.18.112.126:44491)
0810 03:12:33.241697 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:33.241703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:33.242962 (+ 1259us) server_negotiation.cc:407] Connection header received
0810 03:12:33.245073 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:33.245079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:33.245165 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:33.245249 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:33.247217 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.248377 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.250797 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.251241 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.251369 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.256294 (+ 4925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:33.256300 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:33.256304 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:33.256344 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:33.259336 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.260249 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.260254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.260258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.260418 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.261000 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.261006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.261009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.261344 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:33.261486 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:33.262347 (+ 861us) server_negotiation.cc:299] Negotiation successful
0810 03:12:33.262577 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 03:12:33.264701 21677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.241971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.65:44069)
0810 03:12:33.242783 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:33.242838 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:33.244804 (+ 1966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:33.245472 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:33.245480 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:33.246134 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:33.247009 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.247038 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.248545 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.248551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.250626 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.250642 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.251582 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.251592 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.251947 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.252775 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:33.252813 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:33.256007 (+ 3194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:33.259462 (+ 3455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.259471 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.259490 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.260139 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.260570 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.260575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.260581 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.260879 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.261549 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:33.261555 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:33.261981 (+ 426us) client_negotiation.cc:769] Sending connection context
0810 03:12:33.262245 (+ 264us) client_negotiation.cc:240] Negotiation successful
0810 03:12:33.262772 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":344,"threads_started":1}
I20260810 03:12:33.277756 21645 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:41957
I20260810 03:12:33.277809 21846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:41957 every 8 connection(s)
I20260810 03:12:33.279029 21645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:33.281078 21849 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44491
I20260810 03:12:33.281308 21849 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:33.281621 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21645
I20260810 03:12:33.281848 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:33.282102 21849 heartbeater.cc:511] Master 127.18.112.126:44491 requested a full tablet report, sending...
I20260810 03:12:33.282640 18881 external_mini_cluster.cc:1428] Setting key a8ad6eb4dd51912e8b12a00e784e75f4
I20260810 03:12:33.284229 21540 ts_manager.cc:194] Registered new tserver with Master: 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957)
I20260810 03:12:33.286170 21540 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:44069
I20260810 03:12:33.291460 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.278198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:49893 (local address 127.18.112.126:44491)
0810 03:12:33.278370 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:33.278376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:33.278958 (+ 582us) server_negotiation.cc:407] Connection header received
0810 03:12:33.279121 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:33.279125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:33.279194 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:33.279273 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:33.280558 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.281544 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.283366 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.283885 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.284007 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.286143 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:33.286150 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:33.286158 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:33.286195 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:33.288821 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.289543 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.289548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.289551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.289720 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.290070 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.290075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.290078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.290397 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:33.290528 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:33.290920 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 03:12:33.291107 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:12:33.291515 21847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.278247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.65:49893)
0810 03:12:33.278862 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:33.278880 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:33.279002 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:33.279316 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:33.279320 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:33.279924 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:33.280426 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.280440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.281699 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.281705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.283220 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.283235 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.284070 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.284076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.284250 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.285012 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:33.285035 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:33.285946 (+ 911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:33.288944 (+ 2998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.288949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.288954 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.289403 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.289814 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.289820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.289824 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.289970 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.290498 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:33.290503 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:33.290692 (+ 189us) client_negotiation.cc:769] Sending connection context
0810 03:12:33.290812 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 03:12:33.291085 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":318,"threads_started":1}
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:33.322099 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44491
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:33.634656 21861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:33.634928 21861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:33.635071 21861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:33.642082 21861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:33.642197 21861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:33.642318 21861 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:12:33.642390 21861 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:33.642490 21861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:33.651820 21861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:33.653047 21861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:33.654337 21861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:33.668882 21867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:33.668849 21868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:33.669634 21871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:33.669862 21861 server_base.cc:1034] running on GCE node
I20260810 03:12:33.670416 21861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:33.671312 21861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:33.672523 21861 hybrid_clock.cc:648] HybridClock initialized: now 1786331553672467 us; error 48 us; skew 500 ppm
I20260810 03:12:33.672807 21861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:33 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331553, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:33.675743 21861 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:33.677094 21861 webserver.cc:460] Webserver started at http://127.18.112.66:43153/ using document root <none> and password file <none>
I20260810 03:12:33.677712 21861 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:33.677814 21861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:33.678063 21861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:33.680809 21861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "2b84f71701df479bb90d42e85a1381cb"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "fbcab0160b3f5af7300feab415fdf279"
server_key_iv: "7a280758ae5a9da998c6e0240b203f8c"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.681471 21861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "2b84f71701df479bb90d42e85a1381cb"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "fbcab0160b3f5af7300feab415fdf279"
server_key_iv: "7a280758ae5a9da998c6e0240b203f8c"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.686192 21861 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:33.689471 21883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:33.690716 21861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:12:33.690860 21861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "2b84f71701df479bb90d42e85a1381cb"
format_stamp: "Formatted at 2026-08-10 03:12:33 on dist-test-slave-jlzn"
server_key: "fbcab0160b3f5af7300feab415fdf279"
server_key_iv: "7a280758ae5a9da998c6e0240b203f8c"
server_key_version: "encryptionkey@0"
I20260810 03:12:33.691020 21861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:33.705605 21861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:33.709661 21861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:33.709890 21861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:33.712448 21861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:33.712618 21861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 03:12:33.712749 21861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:33.712864 21861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:12:33 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331553, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:33.734510 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.712742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:44501 (local address 127.18.112.126:44491)
0810 03:12:33.712900 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:33.712905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:33.714237 (+ 1332us) server_negotiation.cc:407] Connection header received
0810 03:12:33.716228 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:33.716235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:33.716325 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:33.716438 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:33.718147 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.719086 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.721747 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.722366 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.722484 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.727529 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:33.727537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:33.727542 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:33.727581 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:33.730939 (+ 3358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.731924 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.731929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.731933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.732074 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.732570 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.732575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.732578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.732953 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:33.733092 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:33.733958 (+ 866us) server_negotiation.cc:299] Negotiation successful
0810 03:12:33.734199 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:12:33.736001 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.713333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.66:44501)
0810 03:12:33.714078 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:33.714123 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:33.715929 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:33.716611 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:33.716619 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:33.717160 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:33.717961 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.717993 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.719296 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.719302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.721551 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.721565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.722792 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.722801 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.723082 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.723820 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:33.723855 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:33.727257 (+ 3402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:33.731102 (+ 3845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.731113 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.731140 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.731788 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.732177 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.732182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.732186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.732438 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.733069 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:33.733078 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:33.733530 (+ 452us) client_negotiation.cc:769] Sending connection context
0810 03:12:33.733836 (+ 306us) client_negotiation.cc:240] Negotiation successful
0810 03:12:33.734412 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":318,"threads_started":1}
I20260810 03:12:33.762377 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.747250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:46409 (local address 127.18.112.126:44491)
0810 03:12:33.747457 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:33.747464 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:33.748300 (+ 836us) server_negotiation.cc:407] Connection header received
0810 03:12:33.748525 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:33.748531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:33.748632 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:33.748734 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:33.750039 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.751030 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.753115 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.753527 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.753637 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.756168 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:33.756175 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:33.756179 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:33.756218 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:33.759044 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.760059 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.760065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.760068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.760220 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:33.760665 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:33.760670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:33.760673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:33.761101 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:33.761254 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:33.761776 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 03:12:33.762012 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:12:33.762549 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:33.747183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.66:46409)
0810 03:12:33.748182 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:33.748206 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:33.748363 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:33.748768 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:33.748773 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:33.749429 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:33.749909 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.749921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.751160 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.751166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.752976 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:33.752990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:33.753722 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:33.753728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:33.753923 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:33.754655 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:33.754683 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:33.755941 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:33.759193 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.759200 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.759205 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.759885 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.760343 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:33.760352 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:33.760356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:33.760535 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:33.761242 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:33.761248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:33.761475 (+ 227us) client_negotiation.cc:769] Sending connection context
0810 03:12:33.761651 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 03:12:33.762004 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":646,"threads_started":1}
I20260810 03:12:33.767345 21861 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:33701
I20260810 03:12:33.767393 22066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:33701 every 8 connection(s)
I20260810 03:12:33.768512 21861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:33.769498 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21861
I20260810 03:12:33.769701 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:33.770092 18881 external_mini_cluster.cc:1428] Setting key d1e09a3c211570dd1a25c09e3fd7d853
I20260810 03:12:33.771744 22068 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44491
I20260810 03:12:33.771965 22068 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:33.772574 22068 heartbeater.cc:511] Master 127.18.112.126:44491 requested a full tablet report, sending...
I20260810 03:12:33.773797 21538 ts_manager.cc:194] Registered new tserver with Master: 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701)
I20260810 03:12:33.774636 21538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:44501
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:33.810748 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44491
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:34.124293 22073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:34.124558 22073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:34.124724 22073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:34.131697 22073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:34.131820 22073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:34.131958 22073 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:12:34.132022 22073 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:12:34.132125 22073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:34.141469 22073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:34.142663 22073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:34.144002 22073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:34.156270 22083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:34.156303 22086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:34.156332 22084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:34.157183 22073 server_base.cc:1034] running on GCE node
I20260810 03:12:34.157737 22073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:34.158578 22073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:34.159775 22073 hybrid_clock.cc:648] HybridClock initialized: now 1786331554159719 us; error 46 us; skew 500 ppm
I20260810 03:12:34.160101 22073 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:34 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331554, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:34.163156 22073 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:34.164592 22073 webserver.cc:460] Webserver started at http://127.18.112.67:39903/ using document root <none> and password file <none>
I20260810 03:12:34.165203 22073 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:34.165314 22073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:34.165621 22073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:34.168576 22073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "e3bcd6f44aa847f1959a79a24b098317"
format_stamp: "Formatted at 2026-08-10 03:12:34 on dist-test-slave-jlzn"
server_key: "3bfc79340be1e347acdab6818b4104ca"
server_key_iv: "2f8c9ab811b631257cedf39d166442a4"
server_key_version: "encryptionkey@0"
I20260810 03:12:34.169288 22073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "e3bcd6f44aa847f1959a79a24b098317"
format_stamp: "Formatted at 2026-08-10 03:12:34 on dist-test-slave-jlzn"
server_key: "3bfc79340be1e347acdab6818b4104ca"
server_key_iv: "2f8c9ab811b631257cedf39d166442a4"
server_key_version: "encryptionkey@0"
I20260810 03:12:34.174085 22073 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260810 03:12:34.177441 22098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:34.178625 22073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:12:34.178766 22073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "e3bcd6f44aa847f1959a79a24b098317"
format_stamp: "Formatted at 2026-08-10 03:12:34 on dist-test-slave-jlzn"
server_key: "3bfc79340be1e347acdab6818b4104ca"
server_key_iv: "2f8c9ab811b631257cedf39d166442a4"
server_key_version: "encryptionkey@0"
I20260810 03:12:34.178936 22073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:34.206583 22073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:34.210623 22073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:34.210853 22073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:34.213487 22073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:34.213626 22073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:34.213796 22073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:34.213909 22073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:12:34 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331554, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:34.234630 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.213795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:49447 (local address 127.18.112.126:44491)
0810 03:12:34.213951 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.213957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.215322 (+ 1365us) server_negotiation.cc:407] Connection header received
0810 03:12:34.217393 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.217399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.217491 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.217600 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:34.219413 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.220416 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.223251 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.223674 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.223843 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.228429 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:34.228434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:34.228437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:34.228469 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:34.231296 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.232279 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.232284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.232288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.232423 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.233011 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.233017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.233020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.233286 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:34.233396 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.234209 (+ 813us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.234380 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:12:34.236281 22112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.214423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.67:49447)
0810 03:12:34.215163 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.215208 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.217065 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.217776 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.217783 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.218385 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:34.219206 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.219229 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.220574 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.220580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.223102 (+ 2522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.223120 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.223956 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.223966 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.224286 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.225086 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:34.225117 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:34.228193 (+ 3076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:34.231462 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.231471 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.231485 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.232169 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.232538 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.232543 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.232548 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.232869 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.233415 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:34.233423 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:34.233842 (+ 419us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.234145 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.234658 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":307,"threads_started":1}
I20260810 03:12:34.255503 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.241501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:38885 (local address 127.18.112.126:44491)
0810 03:12:34.241683 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.241688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.242242 (+ 554us) server_negotiation.cc:407] Connection header received
0810 03:12:34.242386 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.242390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.242444 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.242514 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:34.243780 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.244724 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.246450 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.247008 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.247125 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.249392 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:34.249398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:34.249403 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:34.249441 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:34.252653 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.253424 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.253429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.253432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.253620 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.254088 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.254093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.254096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.254404 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:34.254535 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.254954 (+ 419us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.255151 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:12:34.255573 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.241513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.18.112.67:38885)
0810 03:12:34.242140 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.242162 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.242294 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.242553 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.242558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.243183 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:34.243625 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.243638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.244859 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.244863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.246258 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.246270 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.247338 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.247346 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.247532 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.248163 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:34.248187 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:34.249205 (+ 1018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:34.252784 (+ 3579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.252789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.252792 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.253303 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.253765 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.253771 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.253779 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.253952 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.254530 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:34.254534 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:34.254709 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.254830 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.255125 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":323,"threads_started":1}
I20260810 03:12:34.262468 22073 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:43587
I20260810 03:12:34.262516 22273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:43587 every 8 connection(s)
I20260810 03:12:34.263734 22073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:34.265465 22275 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44491
I20260810 03:12:34.265671 22275 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:34.266247 22275 heartbeater.cc:511] Master 127.18.112.126:44491 requested a full tablet report, sending...
I20260810 03:12:34.267587 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 22073
I20260810 03:12:34.267596 21538 ts_manager.cc:194] Registered new tserver with Master: e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:34.267786 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:34.268287 18881 external_mini_cluster.cc:1428] Setting key 11d6531e21cbc96d86f09caba16b2ee0
I20260810 03:12:34.268452 21538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:49447
I20260810 03:12:34.271754 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:12:34.289794 21849 heartbeater.cc:503] Master 127.18.112.126:44491 was elected leader, sending a full tablet report...
Aug 10 03:12:34 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:12:34 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:34.320676 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.307419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49344 (local address 127.18.112.126:44491)
0810 03:12:34.307598 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.307604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.308001 (+ 397us) server_negotiation.cc:407] Connection header received
0810 03:12:34.308203 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.308207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.308277 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.308359 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:34.309756 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.310472 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.311704 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.312174 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.312284 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.315862 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:34.315868 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:34.315873 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:34.315908 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:34.318214 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.318802 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.318808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.318811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.318941 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.319296 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.319301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.319305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.319572 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:34.319834 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.320136 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.320371 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:12:34.324551 21538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:34.331260 21538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:34.354310 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.342854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.0.0.1:55496)
0810 03:12:34.343879 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.343919 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.344100 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.345185 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.345194 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.345234 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.345687 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.345699 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.347769 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.347775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.350305 (+ 2530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.350320 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.352682 (+ 2362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.352691 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.353220 (+ 529us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.353607 (+ 387us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.353744 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.353936 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":589,"threads_started":1}
I20260810 03:12:34.355378 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.343201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55496 (local address 127.18.112.67:43587)
0810 03:12:34.343987 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.343996 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.344029 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:12:34.344352 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.344360 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.344612 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.344822 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.345924 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.347587 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.350490 (+ 2903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.352166 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.352295 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.354816 (+ 2521us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.354889 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.355066 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":1277,"threads_started":1}
I20260810 03:12:34.359495 22173 tablet_service.cc:1467] Processing CreateTablet for tablet 63083e2700c843639d683264dcbf188c (DEFAULT_TABLE table=test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:34.361146 22173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63083e2700c843639d683264dcbf188c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:34.361166 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.344296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42222 (local address 127.18.112.65:41957)
0810 03:12:34.353528 (+ 9232us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.353536 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.354017 (+ 481us) server_negotiation.cc:407] Connection header received
0810 03:12:34.354120 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.354128 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.354851 (+ 723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.355050 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.355991 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.357078 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.358896 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.360203 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.360332 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.360526 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.360730 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.360886 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9074,"thread_start_us":8841,"threads_started":1}
I20260810 03:12:34.361224 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.343714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41957 (local address 127.0.0.1:42222)
0810 03:12:34.353745 (+ 10031us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.353767 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.353876 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.355270 (+ 1394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.355274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.355299 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.355727 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.355746 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.357217 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.357222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.358752 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.358765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.360393 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.360399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.360550 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.360583 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.360672 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.360792 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9884,"mutex_wait_us":23,"thread_start_us":9746,"threads_started":1}
I20260810 03:12:34.362489 22304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.344741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39058 (local address 127.18.112.66:33701)
0810 03:12:34.354648 (+ 9907us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.354654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.354676 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:12:34.354772 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.354779 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.354989 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.355188 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.356092 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.357251 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.359863 (+ 2612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.361346 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.361465 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.361656 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.362175 (+ 519us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.362289 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9774,"thread_start_us":9653,"threads_started":1}
I20260810 03:12:34.362592 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.344228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33701 (local address 127.0.0.1:39058)
0810 03:12:34.354058 (+ 9830us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.354080 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.354211 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.355400 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.355403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.355427 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.355883 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.355896 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.357406 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.357411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.359617 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.359633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.361808 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.361815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.361975 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.362007 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.362112 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.362226 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9704,"mutex_wait_us":26,"thread_start_us":9567,"threads_started":1}
I20260810 03:12:34.364532 21739 tablet_service.cc:1467] Processing CreateTablet for tablet 63083e2700c843639d683264dcbf188c (DEFAULT_TABLE table=test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:34.365202 21967 tablet_service.cc:1467] Processing CreateTablet for tablet 63083e2700c843639d683264dcbf188c (DEFAULT_TABLE table=test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:34.365774 21739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63083e2700c843639d683264dcbf188c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:34.366372 21967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63083e2700c843639d683264dcbf188c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:34.376641 22307 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Bootstrap starting.
I20260810 03:12:34.379488 22312 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Bootstrap starting.
I20260810 03:12:34.380169 22307 tablet_bootstrap.cc:654] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:34.380913 22310 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Bootstrap starting.
I20260810 03:12:34.382611 22307 log.cc:824] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:34.382937 22312 tablet_bootstrap.cc:654] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:34.383858 22310 tablet_bootstrap.cc:654] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:34.384030 22312 log.cc:824] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:34.384951 22310 log.cc:824] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:34.385782 22307 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: No bootstrap required, opened a new log
I20260810 03:12:34.386049 22307 ts_tablet_manager.cc:1397] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260810 03:12:34.386958 22312 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: No bootstrap required, opened a new log
I20260810 03:12:34.387216 22312 ts_tablet_manager.cc:1397] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 03:12:34.387295 22310 tablet_bootstrap.cc:492] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: No bootstrap required, opened a new log
I20260810 03:12:34.387532 22310 ts_tablet_manager.cc:1397] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:12:34.394793 22310 raft_consensus.cc:348] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.395215 22310 raft_consensus.cc:374] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.395355 22310 raft_consensus.cc:729] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.395961 22310 consensus_queue.cc:260] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.396986 22275 heartbeater.cc:503] Master 127.18.112.126:44491 was elected leader, sending a full tablet report...
I20260810 03:12:34.397454 22310 ts_tablet_manager.cc:1428] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260810 03:12:34.397179 22312 raft_consensus.cc:348] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.397574 22312 raft_consensus.cc:374] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.397689 22312 raft_consensus.cc:729] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.396747 22307 raft_consensus.cc:348] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.397925 22307 raft_consensus.cc:374] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.398084 22307 raft_consensus.cc:729] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.398468 22312 consensus_queue.cc:260] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.398629 22307 consensus_queue.cc:260] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.399591 22068 heartbeater.cc:503] Master 127.18.112.126:44491 was elected leader, sending a full tablet report...
I20260810 03:12:34.400189 22307 ts_tablet_manager.cc:1428] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260810 03:12:34.402644 22312 ts_tablet_manager.cc:1428] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Time spent starting tablet: real 0.015s user 0.012s sys 0.003s
I20260810 03:12:34.414829 22321 raft_consensus.cc:482] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:34.415068 22321 raft_consensus.cc:504] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.416600 22321 leader_election.cc:288] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587), 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957)
I20260810 03:12:34.423271 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.416960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:34571 (local address 127.18.112.65:41957)
0810 03:12:34.417190 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.417197 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.417888 (+ 691us) server_negotiation.cc:407] Connection header received
0810 03:12:34.418052 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.418056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.418107 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.418186 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.418784 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.419552 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.421624 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.422364 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.422512 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.422581 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.422915 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.423033 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260810 03:12:34.423298 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.417060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:45955 (local address 127.18.112.67:43587)
0810 03:12:34.417240 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.417245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.417810 (+ 565us) server_negotiation.cc:407] Connection header received
0810 03:12:34.417977 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.417981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.418036 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.418108 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.418656 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.419350 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.421462 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.422275 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.422400 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.422463 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.422858 (+ 395us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.422988 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:12:34.423352 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.416844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.18.112.66:45955)
0810 03:12:34.417709 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.417726 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.417857 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.418133 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.418139 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.418164 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.418520 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.418530 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.419476 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.419481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.421305 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.421317 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.422498 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.422505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.422694 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.422737 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.422805 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.422909 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":6,"thread_start_us":536,"threads_started":1}
I20260810 03:12:34.423475 22323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.417039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41957 (local address 127.18.112.66:34571)
0810 03:12:34.417793 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.417807 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.417927 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.418216 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.418221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.418278 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.418648 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.418658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.419700 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.419706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.421471 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.421486 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.422584 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.422589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.422759 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.422784 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.422878 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.423002 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"mutex_wait_us":38,"spinlock_wait_cycles":1280,"thread_start_us":460,"threads_started":1}
I20260810 03:12:34.424448 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63083e2700c843639d683264dcbf188c" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4" is_pre_election: true
I20260810 03:12:34.424448 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63083e2700c843639d683264dcbf188c" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317" is_pre_election: true
I20260810 03:12:34.424976 21768 raft_consensus.cc:2454] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:34.424980 22211 raft_consensus.cc:2454] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:34.425617 21888 leader_election.cc:302] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, 2b84f71701df479bb90d42e85a1381cb, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:34.426038 22321 raft_consensus.cc:2781] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:34.426169 22321 raft_consensus.cc:482] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:34.426263 22321 raft_consensus.cc:3037] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.428370 22321 raft_consensus.cc:504] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.428892 22321 leader_election.cc:288] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Requested vote from peers e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587), 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957)
I20260810 03:12:34.429297 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63083e2700c843639d683264dcbf188c" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317"
I20260810 03:12:34.429312 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63083e2700c843639d683264dcbf188c" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4"
I20260810 03:12:34.429454 21768 raft_consensus.cc:3037] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.429461 22211 raft_consensus.cc:3037] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.431543 21768 raft_consensus.cc:2454] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:34.431600 22211 raft_consensus.cc:2454] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:34.431926 21888 leader_election.cc:302] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, 2b84f71701df479bb90d42e85a1381cb; no voters:
I20260810 03:12:34.432192 22321 raft_consensus.cc:2781] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:34.432562 22321 raft_consensus.cc:686] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Becoming Leader. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Running, Role: LEADER
I20260810 03:12:34.432963 22321 consensus_queue.cc:237] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } }
I20260810 03:12:34.437328 21538 catalog_manager.cc:5495] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84f71701df479bb90d42e85a1381cb (127.18.112.66). New cstate: current_term: 1 leader_uuid: "2b84f71701df479bb90d42e85a1381cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } health_report { overall_health: UNKNOWN } } }
Aug 10 03:12:34 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331552, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:34.497841 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.485854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44491 (local address 127.0.0.1:49356)
0810 03:12:34.486373 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.486388 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.486498 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.486754 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.486757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.487371 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:34.487618 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.487626 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.488645 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.488649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.489658 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.489670 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.490368 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.490372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.490500 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.491029 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:34.491049 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:34.493084 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:34.495720 (+ 2636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.495729 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.495735 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.496171 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.496479 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:34.496482 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:34.496484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:34.496605 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:34.497014 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:34.497020 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:34.497158 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.497284 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.497463 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":281,"threads_started":1}
I20260810 03:12:34.497874 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.485802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49356 (local address 127.18.112.126:44491)
0810 03:12:34.485953 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.485957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.486459 (+ 502us) server_negotiation.cc:407] Connection header received
0810 03:12:34.486577 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.486581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.486648 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.486720 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:34.487743 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.488525 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.489764 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.490233 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.490323 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.493237 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:34.493241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:34.493245 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:34.493272 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:34.495609 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.496258 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.496262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.496265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.496394 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:34.496682 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:34.496686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:34.496687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:34.496916 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:34.497018 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.497370 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.497566 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":48}
I20260810 03:12:34.502219 21538 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:49356:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:12:34.503186 21538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:34.509186 21739 tablet_service.cc:1467] Processing CreateTablet for tablet d7cfe65236e641309228dd4ef3c3c47b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f19d9b56693848fdb24726014b802d0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:34.509390 21967 tablet_service.cc:1467] Processing CreateTablet for tablet d7cfe65236e641309228dd4ef3c3c47b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f19d9b56693848fdb24726014b802d0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:34.509564 22173 tablet_service.cc:1467] Processing CreateTablet for tablet d7cfe65236e641309228dd4ef3c3c47b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f19d9b56693848fdb24726014b802d0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:12:34.510193 21739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cfe65236e641309228dd4ef3c3c47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:34.510272 21967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cfe65236e641309228dd4ef3c3c47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:34.510360 22173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7cfe65236e641309228dd4ef3c3c47b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 03:12:34.515223 22279 tablet.cc:2369] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:34.515848 22307 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: Bootstrap starting.
I20260810 03:12:34.517081 22312 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: Bootstrap starting.
I20260810 03:12:34.517239 22307 tablet_bootstrap.cc:654] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:34.517988 22310 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: Bootstrap starting.
I20260810 03:12:34.518692 22312 tablet_bootstrap.cc:654] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:34.519215 22310 tablet_bootstrap.cc:654] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: Neither blocks nor log segments found. Creating new log.
W20260810 03:12:34.520406 22070 tablet.cc:2369] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:34.521201 22312 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: No bootstrap required, opened a new log
I20260810 03:12:34.521346 22312 ts_tablet_manager.cc:1397] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260810 03:12:34.521654 22307 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: No bootstrap required, opened a new log
I20260810 03:12:34.521797 22307 ts_tablet_manager.cc:1397] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260810 03:12:34.522121 22312 raft_consensus.cc:348] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.522384 22312 raft_consensus.cc:374] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.522475 22312 raft_consensus.cc:729] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.522385 22307 raft_consensus.cc:348] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.522588 22307 raft_consensus.cc:374] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.522698 22307 raft_consensus.cc:729] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.522709 22312 consensus_queue.cc:260] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.522914 22307 consensus_queue.cc:260] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.523337 22312 ts_tablet_manager.cc:1428] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 03:12:34.523447 22307 ts_tablet_manager.cc:1428] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 03:12:34.523209 22320 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.523597 22320 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:34.523730 22321 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.524044 22321 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:34.525738 22310 tablet_bootstrap.cc:492] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: No bootstrap required, opened a new log
I20260810 03:12:34.525920 22310 ts_tablet_manager.cc:1397] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:12:34.526671 22310 raft_consensus.cc:348] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.526921 22310 raft_consensus.cc:374] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:34.527025 22310 raft_consensus.cc:729] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Initialized, Role: FOLLOWER
I20260810 03:12:34.527266 22310 consensus_queue.cc:260] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.527886 22310 ts_tablet_manager.cc:1428] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 03:12:34.527745 22318 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.528129 22318 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 03:12:34.531280 21853 tablet.cc:2369] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:34.842499 22321 consensus_queue.cc:1035] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:34.850611 22340 consensus_queue.cc:1035] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:34.881937 22318 raft_consensus.cc:482] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:34.882119 22318 raft_consensus.cc:504] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.883522 22318 leader_election.cc:288] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701)
I20260810 03:12:34.889498 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.883968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:52761 (local address 127.18.112.65:41957)
0810 03:12:34.884146 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.884153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.884340 (+ 187us) server_negotiation.cc:407] Connection header received
0810 03:12:34.884640 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.884646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.884724 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.884784 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.885437 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.886241 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.887891 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.888615 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.888757 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.888830 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.889104 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.889235 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:12:34.889570 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.883733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41957 (local address 127.18.112.67:52761)
0810 03:12:34.884245 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.884264 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.884458 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.884988 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.884993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.885012 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.885259 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.885275 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.886377 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.886382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.887727 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.887740 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.888770 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.888775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.888940 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.888967 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.889045 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.889176 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":239,"threads_started":1}
I20260810 03:12:34.889899 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.883899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:35945 (local address 127.18.112.66:33701)
0810 03:12:34.884554 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.884559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.884795 (+ 236us) server_negotiation.cc:407] Connection header received
0810 03:12:34.884937 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.884940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.884997 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.885075 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.885582 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.886382 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.888016 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.888782 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.888928 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.888996 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.889377 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.889563 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":480,"threads_started":1}
I20260810 03:12:34.889864 22320 raft_consensus.cc:482] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:34.890064 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.883733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33701 (local address 127.18.112.67:35945)
0810 03:12:34.884710 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.884726 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.884842 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.885112 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.885116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.885139 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.885449 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.885458 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.886513 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.886518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.887883 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.887896 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.888984 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.888989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.889235 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.889259 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.889335 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.889451 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":290,"thread_start_us":395,"threads_started":1}
I20260810 03:12:34.890048 22320 raft_consensus.cc:504] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.890513 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "e3bcd6f44aa847f1959a79a24b098317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4" is_pre_election: true
I20260810 03:12:34.890791 21768 raft_consensus.cc:2454] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3bcd6f44aa847f1959a79a24b098317 in term 0.
I20260810 03:12:34.891081 22002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "e3bcd6f44aa847f1959a79a24b098317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84f71701df479bb90d42e85a1381cb" is_pre_election: true
I20260810 03:12:34.891242 22101 leader_election.cc:302] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:34.891508 22002 raft_consensus.cc:2454] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3bcd6f44aa847f1959a79a24b098317 in term 0.
I20260810 03:12:34.891587 22318 raft_consensus.cc:2781] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:34.891695 22318 raft_consensus.cc:482] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:34.891678 22320 leader_election.cc:288] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:34.891785 22318 raft_consensus.cc:3037] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.894510 22318 raft_consensus.cc:504] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.895197 22318 leader_election.cc:288] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [CANDIDATE]: Term 1 election: Requested vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701)
I20260810 03:12:34.895537 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "e3bcd6f44aa847f1959a79a24b098317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4"
I20260810 03:12:34.895749 21768 raft_consensus.cc:3037] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.897760 22002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "e3bcd6f44aa847f1959a79a24b098317" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84f71701df479bb90d42e85a1381cb"
I20260810 03:12:34.897957 22002 raft_consensus.cc:3037] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:34.898265 21768 raft_consensus.cc:2454] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3bcd6f44aa847f1959a79a24b098317 in term 1.
I20260810 03:12:34.898674 22101 leader_election.cc:302] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:34.898957 22318 raft_consensus.cc:2781] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:34.899940 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.892114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33701 (local address 127.18.112.65:33383)
0810 03:12:34.892683 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.892700 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.892811 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.893269 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.893275 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.893303 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.893680 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.893691 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.895087 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.895093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.897457 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.897472 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.899082 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.899089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.899281 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.899321 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.899394 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.899526 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":44,"thread_start_us":275,"threads_started":1}
I20260810 03:12:34.900707 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.892145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:33383 (local address 127.18.112.66:33701)
0810 03:12:34.892285 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.892289 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.892914 (+ 625us) server_negotiation.cc:407] Connection header received
0810 03:12:34.892974 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.892979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.893047 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.893123 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.893823 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.894911 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.897637 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.898829 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.900178 (+ 1349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.900254 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.900305 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.900433 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:12:34.901166 22002 raft_consensus.cc:2454] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3bcd6f44aa847f1959a79a24b098317 in term 1.
I20260810 03:12:34.901234 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.892926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:55651 (local address 127.18.112.67:43587)
0810 03:12:34.893074 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.893079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.894311 (+ 1232us) server_negotiation.cc:407] Connection header received
0810 03:12:34.894514 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.894518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.894567 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.894646 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:34.895460 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.896511 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.898880 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.900103 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.900231 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.900295 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.900855 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.900990 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:12:34.901341 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84f71701df479bb90d42e85a1381cb" is_pre_election: true
I20260810 03:12:34.901816 22000 raft_consensus.cc:2379] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23388793216f41af9beb944f3ff800d4 in current term 1: Already voted for candidate e3bcd6f44aa847f1959a79a24b098317 in this term.
I20260810 03:12:34.901834 22349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.892761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.18.112.65:55651)
0810 03:12:34.894229 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.894242 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.894396 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.894810 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.894815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.894839 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:34.895212 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.895223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.896682 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.896691 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.898710 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.898724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.900467 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.900473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.900667 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.900698 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.901375 (+ 677us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.901500 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1373,"mutex_wait_us":22,"thread_start_us":1199,"threads_started":1}
I20260810 03:12:34.902428 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7cfe65236e641309228dd4ef3c3c47b" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317" is_pre_election: true
I20260810 03:12:34.903159 22318 raft_consensus.cc:686] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [term 1 LEADER]: Becoming Leader. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Running, Role: LEADER
I20260810 03:12:34.903568 22318 consensus_queue.cc:237] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:34.906068 21670 leader_election.cc:302] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23388793216f41af9beb944f3ff800d4; no voters: 2b84f71701df479bb90d42e85a1381cb, e3bcd6f44aa847f1959a79a24b098317
I20260810 03:12:34.906016 22351 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: TxnStatusTablet state changed. Reason: New leader e3bcd6f44aa847f1959a79a24b098317. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.906370 22351 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:34.906456 22320 raft_consensus.cc:2726] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 03:12:34.906980 22354 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:12:34.907230 22354 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:12:34.908298 21540 catalog_manager.cc:5495] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67). New cstate: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } health_report { overall_health: HEALTHY } } }
I20260810 03:12:34.973258 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.967219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.0.0.1:55512)
0810 03:12:34.967456 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:34.967475 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:34.967599 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:34.968176 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:34.968179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:34.968189 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:34.968340 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.968348 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.969745 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.969749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.970725 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:34.970735 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.971723 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.971727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:34.971877 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.971931 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:34.972863 (+ 932us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:34.972874 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 03:12:34.972920 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 03:12:34.973027 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:12:34.973383 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:34.967262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.18.112.67:43587)
0810 03:12:34.967432 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:34.967437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:34.967568 (+ 131us) server_negotiation.cc:407] Connection header received
0810 03:12:34.967853 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:34.967860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:34.967983 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:34.968147 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:34.968487 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.969638 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.970857 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:34.971567 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:34.971715 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:34.972097 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:34.972774 (+ 677us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:34.972914 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:34.972987 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 03:12:34.973076 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:12:34.979828 21768 raft_consensus.cc:1261] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Refusing update from remote peer e3bcd6f44aa847f1959a79a24b098317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:34.980036 22000 raft_consensus.cc:1261] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Refusing update from remote peer e3bcd6f44aa847f1959a79a24b098317: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:34.980620 22351 consensus_queue.cc:1035] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:34.981254 22318 consensus_queue.cc:1035] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:34.987556 22340 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: TxnStatusTablet state changed. Reason: New leader e3bcd6f44aa847f1959a79a24b098317. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.987887 22340 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:34.992699 22340 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.992640 22320 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: TxnStatusTablet state changed. Reason: New leader e3bcd6f44aa847f1959a79a24b098317. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.992914 22320 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:34.992920 22340 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 2b84f71701df479bb90d42e85a1381cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:34.993961 22339 mvcc.cc:205] Tried to move back new op lower bound from 7316814049189842944 to 7316814048888549376. Current Snapshot: MvccSnapshot[applied={T|T < 7316814049189842944}]
I20260810 03:12:34.991777 22318 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.995764 22318 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:34.997679 22318 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:34.997893 22318 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P e3bcd6f44aa847f1959a79a24b098317: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:12:35.000721 22343 mvcc.cc:205] Tried to move back new op lower bound from 7316814049189842944 to 7316814048888549376. Current Snapshot: MvccSnapshot[applied={T|T < 7316814049189842944}]
I20260810 03:12:35.006107 22320 tablet_replica.cc:439] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3bcd6f44aa847f1959a79a24b098317" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } } }
I20260810 03:12:35.006356 22320 tablet_replica.cc:442] T d7cfe65236e641309228dd4ef3c3c47b P 23388793216f41af9beb944f3ff800d4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:12:35.011936 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:35.004949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.18.112.66:33701)
0810 03:12:35.005140 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:35.005148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:35.005854 (+ 706us) server_negotiation.cc:407] Connection header received
0810 03:12:35.006183 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:35.006189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:35.006310 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:35.006439 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:35.007179 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.008271 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.009889 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.010293 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.010397 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:35.010802 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:35.011303 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:35.011431 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:35.011548 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 03:12:35.011629 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 03:12:35.027423 22370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:35.021880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.18.112.66:40529)
0810 03:12:35.022521 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:35.022535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:35.022663 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:35.022963 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:35.022967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:35.022979 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:35.023293 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:35.023303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.024611 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.024617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:35.025560 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:35.025571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.026298 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.026305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:35.026452 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:35.026502 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:35.026906 (+ 404us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:35.026918 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 03:12:35.026986 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 03:12:35.027136 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":338,"threads_started":1}
I20260810 03:12:35.027443 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:35.021881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:40529 (local address 127.18.112.67:43587)
0810 03:12:35.022388 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:35.022394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:35.022615 (+ 221us) server_negotiation.cc:407] Connection header received
0810 03:12:35.022797 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:35.022802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:35.022869 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:35.022945 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:35.023448 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.024474 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.025701 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.026160 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.026266 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:35.026714 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:35.026815 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:35.026886 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:35.027016 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 03:12:35.027096 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378}
I20260810 03:12:35.064352 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:35.056993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:35307 (local address 127.18.112.66:33701)
0810 03:12:35.057266 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:35.057274 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:35.057858 (+ 584us) server_negotiation.cc:407] Connection header received
0810 03:12:35.058169 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:35.058175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:35.058254 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:35.058312 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:35.059051 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.060266 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.062279 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.062919 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.063039 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:35.063548 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:35.063689 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:35.063778 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:35.063978 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 03:12:35.064060 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260810 03:12:35.064491 22372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:35.056984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33701 (local address 127.18.112.67:35307)
0810 03:12:35.057764 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:35.057784 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:35.057982 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:35.058499 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:35.058503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:35.058516 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:35.058841 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:35.058855 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.060948 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.060953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:35.062136 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:35.062152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:35.063103 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:35.063110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:35.063292 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:35.063360 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:35.063845 (+ 485us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:35.063864 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:12:35.063984 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 03:12:35.064107 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":3446,"threads_started":1}
I20260810 03:12:35.099959 21540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:35.100270 21540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:35.104084 21540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Sending DeleteTablet for 3 replicas of tablet 63083e2700c843639d683264dcbf188c
I20260810 03:12:35.105286 22173 tablet_service.cc:1514] Processing DeleteTablet for tablet 63083e2700c843639d683264dcbf188c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:35 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55496
I20260810 03:12:35.105324 21739 tablet_service.cc:1514] Processing DeleteTablet for tablet 63083e2700c843639d683264dcbf188c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:35 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:42222
I20260810 03:12:35.106142 21967 tablet_service.cc:1514] Processing DeleteTablet for tablet 63083e2700c843639d683264dcbf188c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:35 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39058
I20260810 03:12:35.112524 21540 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:35.113371 21540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:35.120551 21737 tablet_service.cc:1467] Processing CreateTablet for tablet b688f909e7244f19b9a637bd9fd2a732 (DEFAULT_TABLE table=test-table [id=53583252eaa741b4827b0f303eefd8e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:35.121074 21737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b688f909e7244f19b9a637bd9fd2a732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:35.122609 22169 tablet_service.cc:1467] Processing CreateTablet for tablet b688f909e7244f19b9a637bd9fd2a732 (DEFAULT_TABLE table=test-table [id=53583252eaa741b4827b0f303eefd8e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:35.123181 22169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b688f909e7244f19b9a637bd9fd2a732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:35.125052 22377 tablet_replica.cc:330] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: stopping tablet replica
I20260810 03:12:35.125535 22377 raft_consensus.cc:2229] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:35.125885 22377 raft_consensus.cc:2258] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:35.128031 22377 ts_tablet_manager.cc:1905] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:35.128839 21964 tablet_service.cc:1467] Processing CreateTablet for tablet b688f909e7244f19b9a637bd9fd2a732 (DEFAULT_TABLE table=test-table [id=53583252eaa741b4827b0f303eefd8e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:35.129366 21964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b688f909e7244f19b9a637bd9fd2a732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:35.135186 22377 ts_tablet_manager.cc:1918] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:35.135504 22377 log.cc:1196] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/63083e2700c843639d683264dcbf188c
I20260810 03:12:35.136161 22377 ts_tablet_manager.cc:1939] T 63083e2700c843639d683264dcbf188c P e3bcd6f44aa847f1959a79a24b098317: Deleting consensus metadata
I20260810 03:12:35.138013 21515 catalog_manager.cc:4841] TS e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587): tablet 63083e2700c843639d683264dcbf188c (table test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]) successfully deleted
I20260810 03:12:35.144375 22380 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Bootstrap starting.
I20260810 03:12:35.146539 22380 tablet_bootstrap.cc:654] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:35.154789 22383 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Bootstrap starting.
I20260810 03:12:35.156808 22383 tablet_bootstrap.cc:654] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:35.161619 22379 tablet_replica.cc:330] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: stopping tablet replica
I20260810 03:12:35.162117 22379 raft_consensus.cc:2229] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:35.162878 22379 raft_consensus.cc:2258] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:35.163362 22381 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Bootstrap starting.
I20260810 03:12:35.165110 22376 tablet_replica.cc:330] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: stopping tablet replica
I20260810 03:12:35.165931 22379 ts_tablet_manager.cc:1905] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:35.166229 22381 tablet_bootstrap.cc:654] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:35.166702 22376 raft_consensus.cc:2229] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:35.167044 22376 raft_consensus.cc:2258] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:35.170871 22383 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: No bootstrap required, opened a new log
I20260810 03:12:35.171025 22383 ts_tablet_manager.cc:1397] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260810 03:12:35.171919 22383 raft_consensus.cc:348] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.172186 22383 raft_consensus.cc:374] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:35.172976 22376 ts_tablet_manager.cc:1905] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:35.176134 22383 raft_consensus.cc:729] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Initialized, Role: FOLLOWER
I20260810 03:12:35.176499 22383 consensus_queue.cc:260] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.177356 22383 ts_tablet_manager.cc:1428] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260810 03:12:35.179895 22381 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: No bootstrap required, opened a new log
I20260810 03:12:35.180084 22381 ts_tablet_manager.cc:1397] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260810 03:12:35.180574 22379 ts_tablet_manager.cc:1918] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:35.180845 22381 raft_consensus.cc:348] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.181137 22381 raft_consensus.cc:374] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:35.181268 22381 raft_consensus.cc:729] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:35.183835 22381 consensus_queue.cc:260] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.184736 22379 log.cc:1196] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/63083e2700c843639d683264dcbf188c
I20260810 03:12:35.185364 22379 ts_tablet_manager.cc:1939] T 63083e2700c843639d683264dcbf188c P 2b84f71701df479bb90d42e85a1381cb: Deleting consensus metadata
I20260810 03:12:35.186534 22381 ts_tablet_manager.cc:1428] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260810 03:12:35.187107 21515 catalog_manager.cc:4841] TS 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701): tablet 63083e2700c843639d683264dcbf188c (table test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]) successfully deleted
I20260810 03:12:35.191890 22376 ts_tablet_manager.cc:1918] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:35.192107 22376 log.cc:1196] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/63083e2700c843639d683264dcbf188c
I20260810 03:12:35.192704 22376 ts_tablet_manager.cc:1939] T 63083e2700c843639d683264dcbf188c P 23388793216f41af9beb944f3ff800d4: Deleting consensus metadata
I20260810 03:12:35.192953 22380 tablet_bootstrap.cc:492] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: No bootstrap required, opened a new log
I20260810 03:12:35.193185 22380 ts_tablet_manager.cc:1397] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.019s
I20260810 03:12:35.194079 22380 raft_consensus.cc:348] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.194401 22380 raft_consensus.cc:374] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:35.194550 22380 raft_consensus.cc:729] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Initialized, Role: FOLLOWER
I20260810 03:12:35.194614 21514 catalog_manager.cc:4841] TS 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957): tablet 63083e2700c843639d683264dcbf188c (table test-table [id=7c4c4ad90ebe4038a33a9934a50d321a]) successfully deleted
I20260810 03:12:35.194839 22380 consensus_queue.cc:260] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.195488 22380 ts_tablet_manager.cc:1428] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 03:12:35.284571 22321 raft_consensus.cc:482] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:35.284823 22321 raft_consensus.cc:504] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.285660 22321 leader_election.cc:288] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:35.286705 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b688f909e7244f19b9a637bd9fd2a732" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317" is_pre_election: true
I20260810 03:12:35.286978 22211 raft_consensus.cc:2454] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:35.287993 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b688f909e7244f19b9a637bd9fd2a732" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4" is_pre_election: true
I20260810 03:12:35.288260 21768 raft_consensus.cc:2454] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:35.289024 21889 leader_election.cc:302] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84f71701df479bb90d42e85a1381cb, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:35.290233 22321 raft_consensus.cc:2781] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:35.290378 22321 raft_consensus.cc:482] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:35.290477 22321 raft_consensus.cc:3037] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:35.295274 22321 raft_consensus.cc:504] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.296553 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b688f909e7244f19b9a637bd9fd2a732" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4"
I20260810 03:12:35.296808 21768 raft_consensus.cc:3037] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:35.299825 21768 raft_consensus.cc:2454] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:35.300324 21888 leader_election.cc:302] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, 2b84f71701df479bb90d42e85a1381cb; no voters:
I20260810 03:12:35.300616 22340 raft_consensus.cc:2781] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:35.300791 22340 raft_consensus.cc:686] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Becoming Leader. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Running, Role: LEADER
I20260810 03:12:35.301043 22340 consensus_queue.cc:237] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:35.304586 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b688f909e7244f19b9a637bd9fd2a732" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317"
I20260810 03:12:35.304822 22211 raft_consensus.cc:3037] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:35.308104 22211 raft_consensus.cc:2454] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:35.308712 22321 leader_election.cc:288] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Requested vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:35.316226 21538 catalog_manager.cc:5495] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84f71701df479bb90d42e85a1381cb (127.18.112.66). New cstate: current_term: 1 leader_uuid: "2b84f71701df479bb90d42e85a1381cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260810 03:12:35.355581 22211 raft_consensus.cc:1261] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Refusing update from remote peer 2b84f71701df479bb90d42e85a1381cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:35.355721 21767 raft_consensus.cc:1261] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Refusing update from remote peer 2b84f71701df479bb90d42e85a1381cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:35.356732 22324 consensus_queue.cc:1035] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:35.357303 22324 consensus_queue.cc:1035] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:35.367651 22338 mvcc.cc:205] Tried to move back new op lower bound from 7316814050730979328 to 7316814050515898368. Current Snapshot: MvccSnapshot[applied={T|T < 7316814050730979328}]
W20260810 03:12:35.382364 22338 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 03:12:36.961973 21538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:36.962242 21538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:36.965978 21538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Sending DeleteTablet for 3 replicas of tablet b688f909e7244f19b9a637bd9fd2a732
I20260810 03:12:36.966778 21967 tablet_service.cc:1514] Processing DeleteTablet for tablet b688f909e7244f19b9a637bd9fd2a732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:36 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39058
I20260810 03:12:36.966826 21739 tablet_service.cc:1514] Processing DeleteTablet for tablet b688f909e7244f19b9a637bd9fd2a732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:36 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:42222
I20260810 03:12:36.966917 22169 tablet_service.cc:1514] Processing DeleteTablet for tablet b688f909e7244f19b9a637bd9fd2a732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:36 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55496
I20260810 03:12:36.979095 22428 tablet_replica.cc:330] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: stopping tablet replica
I20260810 03:12:36.979321 22433 tablet_replica.cc:330] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: stopping tablet replica
I20260810 03:12:36.979475 22429 tablet_replica.cc:330] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: stopping tablet replica
I20260810 03:12:36.979516 22428 raft_consensus.cc:2229] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:36.979563 22433 raft_consensus.cc:2229] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:36.979702 22429 raft_consensus.cc:2229] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:36.979781 22433 raft_consensus.cc:2258] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:36.979979 22429 raft_consensus.cc:2258] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:36.980018 22428 raft_consensus.cc:2258] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:36.980907 22429 ts_tablet_manager.cc:1905] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:36.980921 22433 ts_tablet_manager.cc:1905] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:36.985736 22433 ts_tablet_manager.cc:1918] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:36.985852 22433 log.cc:1196] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/b688f909e7244f19b9a637bd9fd2a732
I20260810 03:12:36.986254 22433 ts_tablet_manager.cc:1939] T b688f909e7244f19b9a637bd9fd2a732 P e3bcd6f44aa847f1959a79a24b098317: Deleting consensus metadata
I20260810 03:12:36.986972 22429 ts_tablet_manager.cc:1918] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:36.987098 22429 log.cc:1196] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/b688f909e7244f19b9a637bd9fd2a732
I20260810 03:12:36.987190 21515 catalog_manager.cc:4841] TS e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587): tablet b688f909e7244f19b9a637bd9fd2a732 (table test-table [id=53583252eaa741b4827b0f303eefd8e9]) successfully deleted
I20260810 03:12:36.987494 22429 ts_tablet_manager.cc:1939] T b688f909e7244f19b9a637bd9fd2a732 P 23388793216f41af9beb944f3ff800d4: Deleting consensus metadata
I20260810 03:12:36.988325 22428 ts_tablet_manager.cc:1905] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:36.988545 21514 catalog_manager.cc:4841] TS 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957): tablet b688f909e7244f19b9a637bd9fd2a732 (table test-table [id=53583252eaa741b4827b0f303eefd8e9]) successfully deleted
I20260810 03:12:36.992857 22428 ts_tablet_manager.cc:1918] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:36.992978 22428 log.cc:1196] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/b688f909e7244f19b9a637bd9fd2a732
I20260810 03:12:36.993316 22428 ts_tablet_manager.cc:1939] T b688f909e7244f19b9a637bd9fd2a732 P 2b84f71701df479bb90d42e85a1381cb: Deleting consensus metadata
I20260810 03:12:36.994114 21515 catalog_manager.cc:4841] TS 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701): tablet b688f909e7244f19b9a637bd9fd2a732 (table test-table [id=53583252eaa741b4827b0f303eefd8e9]) successfully deleted
Aug 10 03:12:36 dist-test-slave-jlzn krb5kdc[21470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331556, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:12:37 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331556, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:37.023587 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.011140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.18.112.126:44491)
0810 03:12:37.011649 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:37.011653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:37.011675 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:12:37.011852 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:37.011857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:37.011932 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:37.012024 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:37.013191 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.013950 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.015090 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.015516 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.015603 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.019124 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:37.019137 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:37.019140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:37.019173 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:37.021619 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:37.022157 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:37.022161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:37.022163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:37.022279 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:37.022541 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:37.022543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:37.022545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:37.022775 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:37.022953 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:37.023109 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 03:12:37.023296 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":249,"threads_started":1}
I20260810 03:12:37.026736 21538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:37.027338 21538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:37.033530 21739 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd8096b754044919577244895f68a34 (DEFAULT_TABLE table=test-table [id=cabff020c5c44a2182033b6b11bd37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.033629 21967 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd8096b754044919577244895f68a34 (DEFAULT_TABLE table=test-table [id=cabff020c5c44a2182033b6b11bd37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.033710 22169 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd8096b754044919577244895f68a34 (DEFAULT_TABLE table=test-table [id=cabff020c5c44a2182033b6b11bd37dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.033990 21967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd8096b754044919577244895f68a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.033990 21739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd8096b754044919577244895f68a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.034161 22169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd8096b754044919577244895f68a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.039628 22446 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Bootstrap starting.
I20260810 03:12:37.041389 22446 tablet_bootstrap.cc:654] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.043049 22446 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: No bootstrap required, opened a new log
I20260810 03:12:37.043191 22446 ts_tablet_manager.cc:1397] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 03:12:37.043953 22446 raft_consensus.cc:348] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.044281 22446 raft_consensus.cc:374] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.044438 22446 raft_consensus.cc:729] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.044692 22446 consensus_queue.cc:260] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.045303 22446 ts_tablet_manager.cc:1428] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:37.048591 22447 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Bootstrap starting.
I20260810 03:12:37.050468 22447 tablet_bootstrap.cc:654] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.052124 22449 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Bootstrap starting.
I20260810 03:12:37.053412 22449 tablet_bootstrap.cc:654] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.055065 22447 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: No bootstrap required, opened a new log
I20260810 03:12:37.055199 22447 ts_tablet_manager.cc:1397] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260810 03:12:37.055207 22449 tablet_bootstrap.cc:492] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: No bootstrap required, opened a new log
I20260810 03:12:37.055328 22449 ts_tablet_manager.cc:1397] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:12:37.055846 22447 raft_consensus.cc:348] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.055949 22449 raft_consensus.cc:348] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.056073 22447 raft_consensus.cc:374] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.056159 22447 raft_consensus.cc:729] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.056203 22449 raft_consensus.cc:374] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.056309 22449 raft_consensus.cc:729] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.056401 22447 consensus_queue.cc:260] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.056507 22449 consensus_queue.cc:260] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.056993 22449 ts_tablet_manager.cc:1428] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 03:12:37.057723 22447 ts_tablet_manager.cc:1428] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 03:12:37.196089 22453 raft_consensus.cc:482] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:37.196318 22453 raft_consensus.cc:504] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.196954 22453 leader_election.cc:288] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:37.197432 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd8096b754044919577244895f68a34" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84f71701df479bb90d42e85a1381cb" is_pre_election: true
I20260810 03:12:37.197544 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd8096b754044919577244895f68a34" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317" is_pre_election: true
I20260810 03:12:37.197708 22000 raft_consensus.cc:2454] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23388793216f41af9beb944f3ff800d4 in term 0.
I20260810 03:12:37.197795 22211 raft_consensus.cc:2454] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23388793216f41af9beb944f3ff800d4 in term 0.
I20260810 03:12:37.198135 21670 leader_election.cc:302] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, 2b84f71701df479bb90d42e85a1381cb; no voters:
I20260810 03:12:37.198382 22453 raft_consensus.cc:2781] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:37.198508 22453 raft_consensus.cc:482] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:37.198602 22453 raft_consensus.cc:3037] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.200726 22453 raft_consensus.cc:504] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.201232 22453 leader_election.cc:288] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 election: Requested vote from peers 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:37.201611 22000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd8096b754044919577244895f68a34" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b84f71701df479bb90d42e85a1381cb"
I20260810 03:12:37.201752 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd8096b754044919577244895f68a34" candidate_uuid: "23388793216f41af9beb944f3ff800d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317"
I20260810 03:12:37.201845 22000 raft_consensus.cc:3037] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.201951 22211 raft_consensus.cc:3037] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.204727 22000 raft_consensus.cc:2454] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23388793216f41af9beb944f3ff800d4 in term 1.
I20260810 03:12:37.204739 22211 raft_consensus.cc:2454] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23388793216f41af9beb944f3ff800d4 in term 1.
I20260810 03:12:37.205098 21670 leader_election.cc:302] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:37.205340 22453 raft_consensus.cc:2781] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:37.205782 22453 raft_consensus.cc:686] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 1 LEADER]: Becoming Leader. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Running, Role: LEADER
I20260810 03:12:37.206136 22453 consensus_queue.cc:237] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.209321 21540 catalog_manager.cc:5495] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23388793216f41af9beb944f3ff800d4 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "23388793216f41af9beb944f3ff800d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260810 03:12:37.240120 22460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.234840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42230 (local address 127.18.112.65:41957)
0810 03:12:37.235322 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:37.235326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:37.235344 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:12:37.235417 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:37.235420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:37.235494 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:37.235623 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:37.235958 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.236719 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.238052 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.238448 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.238587 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.238999 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.239551 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.239665 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:37.239720 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 03:12:37.239790 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":291,"threads_started":1}
I20260810 03:12:37.253897 22467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.248666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43587 (local address 127.18.112.65:39521)
0810 03:12:37.249286 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:37.249301 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:37.249426 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:37.249716 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:37.249720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:37.249732 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:37.249997 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:37.250006 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.250979 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.250984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:37.252098 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:37.252110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.252777 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.252783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:37.252904 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.252958 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.253321 (+ 363us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.253332 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 03:12:37.253395 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 03:12:37.253519 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":331,"threads_started":1}
I20260810 03:12:37.253903 22465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.248628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39521 (local address 127.18.112.67:43587)
0810 03:12:37.249190 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:37.249196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:37.249371 (+ 175us) server_negotiation.cc:407] Connection header received
0810 03:12:37.249538 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:37.249541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:37.249608 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:37.249689 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:37.250150 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.250852 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.252232 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.252631 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.252740 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.253117 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.253229 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.253300 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:37.253426 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 03:12:37.253499 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":269,"threads_started":1}
I20260810 03:12:37.261404 22211 raft_consensus.cc:1261] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Refusing update from remote peer 23388793216f41af9beb944f3ff800d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:37.261456 22000 raft_consensus.cc:1261] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Refusing update from remote peer 23388793216f41af9beb944f3ff800d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:37.261966 22455 consensus_queue.cc:1035] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:37.262323 22453 consensus_queue.cc:1035] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:37.292855 22460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.285974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:40537 (local address 127.18.112.65:41957)
0810 03:12:37.286113 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:37.286118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:37.286746 (+ 628us) server_negotiation.cc:407] Connection header received
0810 03:12:37.286911 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:37.286916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:37.286991 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:37.287066 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:37.287555 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.288729 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.290768 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.291470 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.291605 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.292080 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.292217 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.292280 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:37.292514 (+ 234us) server_negotiation.cc:299] Negotiation successful
0810 03:12:37.292592 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 03:12:37.293795 22471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.285978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41957 (local address 127.18.112.67:40537)
0810 03:12:37.286640 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:37.286659 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:37.286788 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:37.287082 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:37.287086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:37.287097 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:12:37.287381 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:37.287393 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.288917 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.288922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:37.290627 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:37.290642 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.291635 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.291642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:37.291842 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.291891 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.292369 (+ 478us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.292379 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 03:12:37.293173 (+ 794us) client_negotiation.cc:240] Negotiation successful
0810 03:12:37.293313 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":376,"threads_started":1}
I20260810 03:12:37.331288 21538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:37.331563 21538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:37.334576 21538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Sending DeleteTablet for 3 replicas of tablet 6cd8096b754044919577244895f68a34
I20260810 03:12:37.335278 21739 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd8096b754044919577244895f68a34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:37 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:42222
I20260810 03:12:37.335539 22429 tablet_replica.cc:330] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: stopping tablet replica
I20260810 03:12:37.335495 21967 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd8096b754044919577244895f68a34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:37 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39058
I20260810 03:12:37.335650 22169 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd8096b754044919577244895f68a34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:37 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55496
I20260810 03:12:37.335724 22429 raft_consensus.cc:2229] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:37.335950 22428 tablet_replica.cc:330] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: stopping tablet replica
I20260810 03:12:37.335975 22433 tablet_replica.cc:330] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: stopping tablet replica
I20260810 03:12:37.336154 22428 raft_consensus.cc:2229] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:37.336166 22433 raft_consensus.cc:2229] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:37.336189 22429 raft_consensus.cc:2258] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:37.336333 22428 raft_consensus.cc:2258] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:37.336333 22433 raft_consensus.cc:2258] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:37.337373 22429 ts_tablet_manager.cc:1905] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:37.337471 22433 ts_tablet_manager.cc:1905] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:37.337955 22428 ts_tablet_manager.cc:1905] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:37.343976 22433 ts_tablet_manager.cc:1918] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:37.344198 22433 log.cc:1196] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/6cd8096b754044919577244895f68a34
I20260810 03:12:37.344139 21538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 03:12:37.344637 22429 ts_tablet_manager.cc:1918] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:37.344744 22433 ts_tablet_manager.cc:1939] T 6cd8096b754044919577244895f68a34 P e3bcd6f44aa847f1959a79a24b098317: Deleting consensus metadata
I20260810 03:12:37.344879 22429 log.cc:1196] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/6cd8096b754044919577244895f68a34
W20260810 03:12:37.344907 21538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:37.345430 22429 ts_tablet_manager.cc:1939] T 6cd8096b754044919577244895f68a34 P 23388793216f41af9beb944f3ff800d4: Deleting consensus metadata
I20260810 03:12:37.345845 21515 catalog_manager.cc:4841] TS e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587): tablet 6cd8096b754044919577244895f68a34 (table test-table [id=cabff020c5c44a2182033b6b11bd37dc]) successfully deleted
I20260810 03:12:37.346369 22428 ts_tablet_manager.cc:1918] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:12:37.346553 22428 log.cc:1196] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/6cd8096b754044919577244895f68a34
I20260810 03:12:37.346654 21514 catalog_manager.cc:4841] TS 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957): tablet 6cd8096b754044919577244895f68a34 (table test-table [id=cabff020c5c44a2182033b6b11bd37dc]) successfully deleted
I20260810 03:12:37.347007 22428 ts_tablet_manager.cc:1939] T 6cd8096b754044919577244895f68a34 P 2b84f71701df479bb90d42e85a1381cb: Deleting consensus metadata
I20260810 03:12:37.347994 21515 catalog_manager.cc:4841] TS 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701): tablet 6cd8096b754044919577244895f68a34 (table test-table [id=cabff020c5c44a2182033b6b11bd37dc]) successfully deleted
I20260810 03:12:37.351717 21739 tablet_service.cc:1467] Processing CreateTablet for tablet cd466401137246bf8762f0a43873d83d (DEFAULT_TABLE table=test-table [id=ec3db20f79304270851f0c924cd80326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.352073 22169 tablet_service.cc:1467] Processing CreateTablet for tablet cd466401137246bf8762f0a43873d83d (DEFAULT_TABLE table=test-table [id=ec3db20f79304270851f0c924cd80326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.352053 21967 tablet_service.cc:1467] Processing CreateTablet for tablet cd466401137246bf8762f0a43873d83d (DEFAULT_TABLE table=test-table [id=ec3db20f79304270851f0c924cd80326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:37.352181 21739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd466401137246bf8762f0a43873d83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.352444 22169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd466401137246bf8762f0a43873d83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.352469 21967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd466401137246bf8762f0a43873d83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:37.358296 22446 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Bootstrap starting.
I20260810 03:12:37.358336 22449 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Bootstrap starting.
I20260810 03:12:37.359330 22447 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Bootstrap starting.
I20260810 03:12:37.359997 22449 tablet_bootstrap.cc:654] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.360000 22446 tablet_bootstrap.cc:654] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.361056 22447 tablet_bootstrap.cc:654] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:37.370054 22446 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: No bootstrap required, opened a new log
I20260810 03:12:37.370249 22446 ts_tablet_manager.cc:1397] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260810 03:12:37.370978 22449 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: No bootstrap required, opened a new log
I20260810 03:12:37.371127 22449 ts_tablet_manager.cc:1397] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260810 03:12:37.370991 22446 raft_consensus.cc:348] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.371259 22446 raft_consensus.cc:374] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.371356 22446 raft_consensus.cc:729] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bcd6f44aa847f1959a79a24b098317, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.371654 22446 consensus_queue.cc:260] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.371912 22449 raft_consensus.cc:348] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.372151 22449 raft_consensus.cc:374] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.372263 22449 raft_consensus.cc:729] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.372478 22449 consensus_queue.cc:260] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.373072 22449 ts_tablet_manager.cc:1428] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:37.373490 22446 ts_tablet_manager.cc:1428] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 03:12:37.374300 22447 tablet_bootstrap.cc:492] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: No bootstrap required, opened a new log
I20260810 03:12:37.374527 22447 ts_tablet_manager.cc:1397] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260810 03:12:37.375872 22447 raft_consensus.cc:348] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.376189 22447 raft_consensus.cc:374] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:37.376317 22447 raft_consensus.cc:729] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23388793216f41af9beb944f3ff800d4, State: Initialized, Role: FOLLOWER
I20260810 03:12:37.376644 22447 consensus_queue.cc:260] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.377339 22447 ts_tablet_manager.cc:1428] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 03:12:37.468178 22324 raft_consensus.cc:482] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:37.468376 22324 raft_consensus.cc:504] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.469161 22324 leader_election.cc:288] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:37.469702 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd466401137246bf8762f0a43873d83d" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4" is_pre_election: true
I20260810 03:12:37.469739 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd466401137246bf8762f0a43873d83d" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317" is_pre_election: true
I20260810 03:12:37.469954 21768 raft_consensus.cc:2454] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:37.470013 22211 raft_consensus.cc:2454] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 0.
I20260810 03:12:37.470444 21888 leader_election.cc:302] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23388793216f41af9beb944f3ff800d4, 2b84f71701df479bb90d42e85a1381cb; no voters:
I20260810 03:12:37.470727 22324 raft_consensus.cc:2781] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:37.470861 22324 raft_consensus.cc:482] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:37.470957 22324 raft_consensus.cc:3037] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.473953 22324 raft_consensus.cc:504] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.474575 22324 leader_election.cc:288] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Requested vote from peers 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957), e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587)
I20260810 03:12:37.475037 22211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd466401137246bf8762f0a43873d83d" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bcd6f44aa847f1959a79a24b098317"
I20260810 03:12:37.475030 21768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd466401137246bf8762f0a43873d83d" candidate_uuid: "2b84f71701df479bb90d42e85a1381cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23388793216f41af9beb944f3ff800d4"
I20260810 03:12:37.475220 22211 raft_consensus.cc:3037] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.475255 21768 raft_consensus.cc:3037] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:37.477262 22211 raft_consensus.cc:2454] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:37.477645 21889 leader_election.cc:302] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b84f71701df479bb90d42e85a1381cb, e3bcd6f44aa847f1959a79a24b098317; no voters:
I20260810 03:12:37.477914 22324 raft_consensus.cc:2781] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:37.478289 22324 raft_consensus.cc:686] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Becoming Leader. State: Replica: 2b84f71701df479bb90d42e85a1381cb, State: Running, Role: LEADER
I20260810 03:12:37.478721 21768 raft_consensus.cc:2454] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b84f71701df479bb90d42e85a1381cb in term 1.
I20260810 03:12:37.478621 22324 consensus_queue.cc:237] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } }
I20260810 03:12:37.481676 21538 catalog_manager.cc:5495] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b84f71701df479bb90d42e85a1381cb (127.18.112.66). New cstate: current_term: 1 leader_uuid: "2b84f71701df479bb90d42e85a1381cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b84f71701df479bb90d42e85a1381cb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260810 03:12:37.528452 22484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:37.521778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39064 (local address 127.18.112.66:33701)
0810 03:12:37.523047 (+ 1269us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:37.523051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:37.523072 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:12:37.523120 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:37.523123 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:37.523183 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:37.523261 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:37.523723 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.524746 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.526662 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:37.527078 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:37.527174 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:37.527610 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:37.527722 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:37.527784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:37.527951 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 03:12:37.528010 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1173,"thread_start_us":1051,"threads_started":1}
I20260810 03:12:37.537036 22211 raft_consensus.cc:1261] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Refusing update from remote peer 2b84f71701df479bb90d42e85a1381cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:37.537397 21768 raft_consensus.cc:1261] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Refusing update from remote peer 2b84f71701df479bb90d42e85a1381cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:37.537761 22481 consensus_queue.cc:1035] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bcd6f44aa847f1959a79a24b098317" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:37.538067 22324 consensus_queue.cc:1035] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "23388793216f41af9beb944f3ff800d4" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:12:37.560184 22403 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 03:12:39.132804 21538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:39.133030 21538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:39.136708 21538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 162b897a217d43f38ccb0def31f281d4: Sending DeleteTablet for 3 replicas of tablet cd466401137246bf8762f0a43873d83d
I20260810 03:12:39.137358 21739 tablet_service.cc:1514] Processing DeleteTablet for tablet cd466401137246bf8762f0a43873d83d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:39 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:42222
I20260810 03:12:39.137411 21967 tablet_service.cc:1514] Processing DeleteTablet for tablet cd466401137246bf8762f0a43873d83d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:39 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39058
I20260810 03:12:39.137473 22169 tablet_service.cc:1514] Processing DeleteTablet for tablet cd466401137246bf8762f0a43873d83d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:39 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:55496
I20260810 03:12:39.138062 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21645
I20260810 03:12:39.140314 22518 tablet_replica.cc:330] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: stopping tablet replica
I20260810 03:12:39.140493 22518 raft_consensus.cc:2229] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:39.140689 22518 raft_consensus.cc:2258] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:39.141532 22518 ts_tablet_manager.cc:1905] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:39.146888 22518 ts_tablet_manager.cc:1918] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:39.147090 22518 log.cc:1196] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/cd466401137246bf8762f0a43873d83d
I20260810 03:12:39.147585 22518 ts_tablet_manager.cc:1939] T cd466401137246bf8762f0a43873d83d P 23388793216f41af9beb944f3ff800d4: Deleting consensus metadata
I20260810 03:12:39.148689 21514 catalog_manager.cc:4841] TS 23388793216f41af9beb944f3ff800d4 (127.18.112.65:41957): tablet cd466401137246bf8762f0a43873d83d (table test-table [id=ec3db20f79304270851f0c924cd80326]) successfully deleted
I20260810 03:12:39.148885 22519 tablet_replica.cc:330] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: stopping tablet replica
I20260810 03:12:39.149104 22520 tablet_replica.cc:330] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: stopping tablet replica
I20260810 03:12:39.149107 22519 raft_consensus.cc:2229] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:39.149291 22520 raft_consensus.cc:2229] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:39.149458 22519 raft_consensus.cc:2258] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:39.149516 22520 raft_consensus.cc:2258] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:39.150283 22519 ts_tablet_manager.cc:1905] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:39.150949 22520 ts_tablet_manager.cc:1905] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:39.154960 22519 ts_tablet_manager.cc:1918] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:39.155077 22519 log.cc:1196] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/cd466401137246bf8762f0a43873d83d
I20260810 03:12:39.155431 22519 ts_tablet_manager.cc:1939] T cd466401137246bf8762f0a43873d83d P 2b84f71701df479bb90d42e85a1381cb: Deleting consensus metadata
I20260810 03:12:39.155928 22520 ts_tablet_manager.cc:1918] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:12:39.156081 22520 log.cc:1196] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/cd466401137246bf8762f0a43873d83d
I20260810 03:12:39.156289 21515 catalog_manager.cc:4841] TS 2b84f71701df479bb90d42e85a1381cb (127.18.112.66:33701): tablet cd466401137246bf8762f0a43873d83d (table test-table [id=ec3db20f79304270851f0c924cd80326]) successfully deleted
I20260810 03:12:39.156564 22520 ts_tablet_manager.cc:1939] T cd466401137246bf8762f0a43873d83d P e3bcd6f44aa847f1959a79a24b098317: Deleting consensus metadata
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331556, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:39.157502 21515 catalog_manager.cc:4841] TS e3bcd6f44aa847f1959a79a24b098317 (127.18.112.67:43587): tablet cd466401137246bf8762f0a43873d83d (table test-table [id=ec3db20f79304270851f0c924cd80326]) successfully deleted
I20260810 03:12:39.163444 22523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:39.139396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42238 (local address 127.18.112.65:41957)
0810 03:12:39.141280 (+ 1884us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:39.141285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:39.144431 (+ 3146us) server_negotiation.cc:407] Connection header received
0810 03:12:39.144497 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:39.144502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:39.144577 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:39.144667 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:39.146334 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.147689 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.149937 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.150521 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.150663 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:39.158367 (+ 7704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:39.158381 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:39.158399 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:39.158434 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:39.161146 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.161717 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.161724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.161727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.161849 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.162125 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.162128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.162130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.162463 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:39.162685 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:39.162847 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 03:12:39.163009 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1771,"thread_start_us":1543,"threads_started":1}
W20260810 03:12:39.164175 21834 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42238
W20260810 03:12:39.164743 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21645: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:39.164921 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21645
I20260810 03:12:39.199610 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21861
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331556, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:39.213390 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:39.200333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39068 (local address 127.18.112.66:33701)
0810 03:12:39.200823 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:39.200828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:39.200845 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:12:39.200899 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:39.200902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:39.200970 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:39.201057 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:39.202168 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.202896 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.204134 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.204529 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.204618 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:39.208431 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:39.208445 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:39.208461 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:39.208491 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:39.211128 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.211638 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.211645 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.211647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.211765 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.212107 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.212110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.212112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.212450 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:39.212655 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:39.212857 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 03:12:39.213055 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":251,"threads_started":1}
W20260810 03:12:39.213999 22059 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39068
W20260810 03:12:39.214540 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21861: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:39.214695 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21861
I20260810 03:12:39.245069 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22073
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[21470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331556, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:39.258862 22525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:39.245780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.18.112.67:43587)
0810 03:12:39.246273 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:39.246278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:39.246294 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:12:39.246346 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:39.246350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:39.246413 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:39.246502 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:39.247673 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.248452 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.249584 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:39.249983 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:39.250067 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:39.254000 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:39.254015 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:39.254031 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:39.254063 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:39.256778 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.257319 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.257326 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.257328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.257454 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:39.257720 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:39.257723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:39.257725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:39.258055 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:39.258282 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:39.258450 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:12:39.258609 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":244,"threads_started":1}
W20260810 03:12:39.259480 22268 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55522
W20260810 03:12:39.260164 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22073: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:39.260300 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 22073
I20260810 03:12:39.289731 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21487
I20260810 03:12:39.290854 21599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:39.404754 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21487
2026-08-10T03:12:39Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9656 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[22532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[22532](info): set up 2 sockets
Aug 10 03:12:39 dist-test-slave-jlzn krb5kdc[22532](info): commencing operation
krb5kdc: starting...
W20260810 03:12:40.588594 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:40 dist-test-slave-jlzn krb5kdc[22532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:40.764312 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44033
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:41.074617 22556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:41.074908 22556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:41.075052 22556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:41.082989 22556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:41.083099 22556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:41.083173 22556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:41.083248 22556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:41.083309 22556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:41.092841 22556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:41.094074 22556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:41.095335 22556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:41.106540 22565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:41.106501 22573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:41.106590 22567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:41.107194 22556 server_base.cc:1034] running on GCE node
I20260810 03:12:41.107999 22556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:41.109272 22556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:41.110471 22556 hybrid_clock.cc:648] HybridClock initialized: now 1786331561110424 us; error 34 us; skew 500 ppm
I20260810 03:12:41.110786 22556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:41 dist-test-slave-jlzn krb5kdc[22532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331561, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:41.113865 22556 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:41.115206 22556 webserver.cc:460] Webserver started at http://127.18.112.126:36267/ using document root <none> and password file <none>
I20260810 03:12:41.115916 22556 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:41.116035 22556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:41.116325 22556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:41.119131 22556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "f74004b8cbd744b4a8e2cabb671a528c"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "2bcab4afd63f0719fcb7de35fb3a7e78"
server_key_iv: "e0e88741b199857b73cb2e4ba06edc3e"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.119881 22556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "f74004b8cbd744b4a8e2cabb671a528c"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "2bcab4afd63f0719fcb7de35fb3a7e78"
server_key_iv: "e0e88741b199857b73cb2e4ba06edc3e"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.124631 22556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:12:41.127738 22582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:41.128970 22556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:12:41.129117 22556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "f74004b8cbd744b4a8e2cabb671a528c"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "2bcab4afd63f0719fcb7de35fb3a7e78"
server_key_iv: "e0e88741b199857b73cb2e4ba06edc3e"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.129284 22556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:41.141204 22556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:41.144695 22556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:41.144940 22556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:41.161309 22556 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44033
I20260810 03:12:41.161338 22656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44033 every 8 connection(s)
I20260810 03:12:41.162586 22556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:41.166005 22657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:41.168800 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 22556
I20260810 03:12:41.168979 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:41.169605 18881 external_mini_cluster.cc:1428] Setting key 01e09e85fc152d33d69df41fd1105452
I20260810 03:12:41.178300 22657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c: Bootstrap starting.
I20260810 03:12:41.181686 22657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:41.182610 22657 log.cc:824] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:12:41 dist-test-slave-jlzn krb5kdc[22532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:41.185575 22657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c: No bootstrap required, opened a new log
I20260810 03:12:41.192728 22660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:41.171376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.18.112.126:44033)
0810 03:12:41.172220 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:41.172234 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:41.172283 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:12:41.174226 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:41.174253 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:41.174744 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:41.175151 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:41.176445 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.178349 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.179567 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.180593 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.180781 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:41.184493 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:41.184503 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:41.184521 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:41.184561 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:41.188455 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:41.189060 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:41.189072 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:41.189080 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:41.189290 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:41.189604 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:41.189609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:41.189612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:41.190306 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:41.190590 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:41.190911 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 03:12:41.191362 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":373,"threads_started":1}
I20260810 03:12:41.195685 22657 raft_consensus.cc:348] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } }
I20260810 03:12:41.196158 22657 raft_consensus.cc:374] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:41.196244 22657 raft_consensus.cc:729] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74004b8cbd744b4a8e2cabb671a528c, State: Initialized, Role: FOLLOWER
I20260810 03:12:41.196733 22657 consensus_queue.cc:260] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } }
I20260810 03:12:41.196947 22657 raft_consensus.cc:388] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:41.197054 22657 raft_consensus.cc:482] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:41.197177 22657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:41.199146 22657 raft_consensus.cc:504] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } }
I20260810 03:12:41.199633 22657 leader_election.cc:302] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f74004b8cbd744b4a8e2cabb671a528c; no voters:
I20260810 03:12:41.200220 22657 leader_election.cc:288] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:41.200328 22662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:41.200970 22662 raft_consensus.cc:686] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [term 1 LEADER]: Becoming Leader. State: Replica: f74004b8cbd744b4a8e2cabb671a528c, State: Running, Role: LEADER
I20260810 03:12:41.201433 22662 consensus_queue.cc:237] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } }
I20260810 03:12:41.202098 22657 sys_catalog.cc:564] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:41.204243 22663 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f74004b8cbd744b4a8e2cabb671a528c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } } }
I20260810 03:12:41.204267 22664 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f74004b8cbd744b4a8e2cabb671a528c. Latest consensus state: current_term: 1 leader_uuid: "f74004b8cbd744b4a8e2cabb671a528c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74004b8cbd744b4a8e2cabb671a528c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44033 } } }
I20260810 03:12:41.204694 22663 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:41.204702 22664 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:41.211658 22686 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 03:12:41.211850 22670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:41.216408 22670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:41.224380 22670 catalog_manager.cc:1347] Generated new cluster ID: 4bbf26ba2f6c455d96a58fa05fc57ac8
I20260810 03:12:41.224475 22670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:41.243376 22670 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:41.244894 22670 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:41.254932 22670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f74004b8cbd744b4a8e2cabb671a528c: Generated new TSK 0
I20260810 03:12:41.255614 22670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:41.307457 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:41.617410 22695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:41.617673 22695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:41.617810 22695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:41.624943 22695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:41.625053 22695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:41.625202 22695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:41.634678 22695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:41.635836 22695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:41.637097 22695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:41.649224 22706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:41.649312 22702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:41.649271 22703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:41.650238 22695 server_base.cc:1034] running on GCE node
I20260810 03:12:41.650808 22695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:41.651647 22695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:41.652841 22695 hybrid_clock.cc:648] HybridClock initialized: now 1786331561652791 us; error 35 us; skew 500 ppm
I20260810 03:12:41.653126 22695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:41 dist-test-slave-jlzn krb5kdc[22532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331561, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:41.656139 22695 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:41.657467 22695 webserver.cc:460] Webserver started at http://127.18.112.65:37603/ using document root <none> and password file <none>
I20260810 03:12:41.658078 22695 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:41.658201 22695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:41.658485 22695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:41.661232 22695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "37b0fdd3790f4e24a821cbfe614e378b"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "7ad0798024566beeafd78b488d849628"
server_key_iv: "cf3592de55ce9f25ab59b1beeaf75f65"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.661959 22695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "37b0fdd3790f4e24a821cbfe614e378b"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "7ad0798024566beeafd78b488d849628"
server_key_iv: "cf3592de55ce9f25ab59b1beeaf75f65"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.666676 22695 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:12:41.669838 22720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:41.670950 22695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:12:41.671099 22695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "37b0fdd3790f4e24a821cbfe614e378b"
format_stamp: "Formatted at 2026-08-10 03:12:41 on dist-test-slave-jlzn"
server_key: "7ad0798024566beeafd78b488d849628"
server_key_iv: "cf3592de55ce9f25ab59b1beeaf75f65"
server_key_version: "encryptionkey@0"
I20260810 03:12:41.671272 22695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:41.684284 22695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:41.687675 22695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:41.687973 22695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:41.688812 22695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:41.690022 22695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:41.690099 22695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:41.690222 22695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:41.690279 22695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:41.719890 22695 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:43245
I20260810 03:12:41.719931 22885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:43245 every 8 connection(s)
I20260810 03:12:41.721037 22695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:41.723476 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 22695
I20260810 03:12:41.723668 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:41.724525 18881 external_mini_cluster.cc:1428] Setting key 50fa53aa0e7c41c485fda162a7aebc02
Aug 10 03:12:41 dist-test-slave-jlzn krb5kdc[22532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331561, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:41.739743 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:41.723206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:60103 (local address 127.18.112.126:44033)
0810 03:12:41.723616 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:41.723622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:41.724695 (+ 1073us) server_negotiation.cc:407] Connection header received
0810 03:12:41.726436 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:41.726442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:41.726523 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:41.726617 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:41.728079 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.728809 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.730304 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.730717 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.730827 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:41.734409 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:41.734414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:41.734418 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:41.734449 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:41.736875 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:41.737546 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:41.737550 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:41.737552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:41.737675 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:41.738080 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:41.738084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:41.738086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:41.738363 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:41.738494 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:41.739157 (+ 663us) server_negotiation.cc:299] Negotiation successful
0810 03:12:41.739382 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":210,"threads_started":1}
I20260810 03:12:41.740618 22892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:41.723798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44033 (local address 127.18.112.65:60103)
0810 03:12:41.724538 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:41.724587 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:41.726186 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:41.726858 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:41.726866 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:41.727333 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:41.727916 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:41.727936 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.728953 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.728958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:41.730167 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:41.730179 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:41.730930 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:41.730938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:41.731162 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:41.731781 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:41.731824 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:41.734196 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:41.737010 (+ 2814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:41.737019 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:41.737033 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:41.737426 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:41.737778 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:41.737783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:41.737787 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:41.737968 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:41.738486 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:41.738493 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:41.738802 (+ 309us) client_negotiation.cc:769] Sending connection context
0810 03:12:41.739025 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 03:12:41.739495 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":289,"threads_started":1}
I20260810 03:12:41.742069 22886 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44033
I20260810 03:12:41.742388 22886 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:12:41.743149 22886 heartbeater.cc:511] Master 127.18.112.126:44033 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
I20260810 03:12:41.745198 22602 ts_manager.cc:194] Registered new tserver with Master: 37b0fdd3790f4e24a821cbfe614e378b (127.18.112.65:43245)
I20260810 03:12:41.746636 22602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:60103
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:41.766584 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:42.075942 22898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:42.076198 22898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:42.076326 22898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:42.083832 22898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:42.083930 22898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:42.084103 22898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:42.093631 22898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:42.094791 22898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:42.096061 22898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:42.108327 22907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:42.108393 22904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:42.108546 22903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:42.109234 22898 server_base.cc:1034] running on GCE node
I20260810 03:12:42.109778 22898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:42.110625 22898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:42.111842 22898 hybrid_clock.cc:648] HybridClock initialized: now 1786331562111784 us; error 32 us; skew 500 ppm
I20260810 03:12:42.112121 22898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[22532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:42.115020 22898 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:42.116319 22898 webserver.cc:460] Webserver started at http://127.18.112.66:38143/ using document root <none> and password file <none>
I20260810 03:12:42.116918 22898 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:42.117033 22898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:42.117318 22898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:42.120007 22898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "b9ae6a43748c410d9d858663913d5d31"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "d6029dbf1b6e108467a4e36b648d7c58"
server_key_iv: "02151d984b2d9152d3f53c2160b7355c"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.120764 22898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "b9ae6a43748c410d9d858663913d5d31"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "d6029dbf1b6e108467a4e36b648d7c58"
server_key_iv: "02151d984b2d9152d3f53c2160b7355c"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.125625 22898 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:42.128758 22915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.129907 22898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:42.130055 22898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "b9ae6a43748c410d9d858663913d5d31"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "d6029dbf1b6e108467a4e36b648d7c58"
server_key_iv: "02151d984b2d9152d3f53c2160b7355c"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.130231 22898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:42.152626 22898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:42.156618 22898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:42.156879 22898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:42.157747 22898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:42.158972 22898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:42.159055 22898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.159183 22898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:42.159236 22898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.190696 22898 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:41363
I20260810 03:12:42.190765 23085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:41363 every 8 connection(s)
I20260810 03:12:42.191962 22898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:42.192236 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 22898
I20260810 03:12:42.192378 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:42.192960 18881 external_mini_cluster.cc:1428] Setting key fc28b79531443aae4d8ec9414ea75672
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[22532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:42.212451 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:42.194554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:44965 (local address 127.18.112.126:44033)
0810 03:12:42.194758 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:42.194764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:42.195965 (+ 1201us) server_negotiation.cc:407] Connection header received
0810 03:12:42.197755 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:42.197761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:42.197838 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:42.197932 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:42.199560 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.200527 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.202417 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.203058 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.203178 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:42.206768 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:42.206773 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:42.206776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:42.206808 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:42.209319 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:42.210233 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:42.210237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:42.210239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:42.210371 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:42.210840 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:42.210842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:42.210845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:42.211085 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:42.211205 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:42.212048 (+ 843us) server_negotiation.cc:299] Negotiation successful
0810 03:12:42.212221 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
I20260810 03:12:42.213769 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:42.194983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44033 (local address 127.18.112.66:44965)
0810 03:12:42.195785 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:42.195859 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:42.197494 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:42.198167 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:42.198177 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:42.198763 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:42.199389 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:42.199408 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.200664 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.200668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:42.202284 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:42.202296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.203247 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.203253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:42.203452 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:42.204108 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:42.204131 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:42.206569 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:42.209469 (+ 2900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:42.209478 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:42.209493 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:42.210128 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:42.210472 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:42.210477 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:42.210481 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:42.210741 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:42.211201 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:42.211208 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:42.211612 (+ 404us) client_negotiation.cc:769] Sending connection context
0810 03:12:42.211951 (+ 339us) client_negotiation.cc:240] Negotiation successful
0810 03:12:42.212442 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":318,"threads_started":1}
I20260810 03:12:42.215101 23086 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44033
I20260810 03:12:42.215376 23086 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:42.216058 23086 heartbeater.cc:511] Master 127.18.112.126:44033 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
I20260810 03:12:42.217489 22602 ts_manager.cc:194] Registered new tserver with Master: b9ae6a43748c410d9d858663913d5d31 (127.18.112.66:41363)
I20260810 03:12:42.218521 22602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:44965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:42.236577 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:42.543270 23091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:42.543545 23091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:42.543691 23091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:42.550649 23091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:42.550760 23091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:42.550918 23091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:42.560036 23091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44033
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:42.561165 23091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:42.562356 23091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:42.574393 23102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:42.574405 23099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:42.574647 23098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:42.575251 23091 server_base.cc:1034] running on GCE node
I20260810 03:12:42.575892 23091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:42.576722 23091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:42.577924 23091 hybrid_clock.cc:648] HybridClock initialized: now 1786331562577875 us; error 42 us; skew 500 ppm
I20260810 03:12:42.578217 23091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[22532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:42.581194 23091 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:42.582549 23091 webserver.cc:460] Webserver started at http://127.18.112.67:46529/ using document root <none> and password file <none>
I20260810 03:12:42.583186 23091 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:42.583303 23091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:42.583580 23091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:42.586630 23091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "6c9524d588dd44639d53d2055387798b"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "afcbade62e9c1d224e38633902bfa2fc"
server_key_iv: "ce4599604b3e1c37b7ca7ddb4cc65fd4"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.587427 23091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "6c9524d588dd44639d53d2055387798b"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "afcbade62e9c1d224e38633902bfa2fc"
server_key_iv: "ce4599604b3e1c37b7ca7ddb4cc65fd4"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.592335 23091 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:12:42.595423 23114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.596660 23091 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:42.596802 23091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "6c9524d588dd44639d53d2055387798b"
format_stamp: "Formatted at 2026-08-10 03:12:42 on dist-test-slave-jlzn"
server_key: "afcbade62e9c1d224e38633902bfa2fc"
server_key_iv: "ce4599604b3e1c37b7ca7ddb4cc65fd4"
server_key_version: "encryptionkey@0"
I20260810 03:12:42.596980 23091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:42.611415 23091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:42.614894 23091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:42.615137 23091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:42.616056 23091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:42.617280 23091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:42.617353 23091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.617465 23091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:42.617520 23091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:42.647274 23091 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:45775
I20260810 03:12:42.647336 23278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:45775 every 8 connection(s)
I20260810 03:12:42.648554 23091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:42.650828 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 23091
I20260810 03:12:42.650991 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:42.651451 18881 external_mini_cluster.cc:1428] Setting key 85e187cc04b6370864124913289588d6
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[22532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:42.667326 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:42.650891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:54441 (local address 127.18.112.126:44033)
0810 03:12:42.651086 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:42.651092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:42.652325 (+ 1233us) server_negotiation.cc:407] Connection header received
0810 03:12:42.654421 (+ 2096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:42.654425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:42.654489 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:42.654576 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:42.656363 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.657076 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.658488 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.658924 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.659013 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:42.662103 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:42.662107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:42.662110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:42.662147 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:42.664381 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:42.665121 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:42.665135 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:42.665138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:42.665288 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:42.665763 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:42.665768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:42.665771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:42.666093 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:42.666245 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:42.666900 (+ 655us) server_negotiation.cc:299] Negotiation successful
0810 03:12:42.667068 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:12:42.668148 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:42.651305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44033 (local address 127.18.112.67:54441)
0810 03:12:42.652146 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:42.652201 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:42.654164 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:42.654829 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:42.654840 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:42.655565 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:42.656208 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:42.656226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.657185 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.657189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:42.658383 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:42.658395 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:42.659081 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:42.659086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:42.659284 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:42.659922 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:42.659943 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:42.661932 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:42.664495 (+ 2563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:42.664502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:42.664511 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:42.665006 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:42.665397 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:42.665401 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:42.665403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:42.665647 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:42.666261 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:42.666268 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:42.666602 (+ 334us) client_negotiation.cc:769] Sending connection context
0810 03:12:42.666802 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 03:12:42.667131 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":345,"threads_started":1}
I20260810 03:12:42.669245 23280 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44033
I20260810 03:12:42.669481 23280 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:42.670089 23280 heartbeater.cc:511] Master 127.18.112.126:44033 requested a full tablet report, sending...
I20260810 03:12:42.671291 22602 ts_manager.cc:194] Registered new tserver with Master: 6c9524d588dd44639d53d2055387798b (127.18.112.67:45775)
I20260810 03:12:42.672096 22602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:54441
I20260810 03:12:42.678108 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:12:42.708032 22890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:12:42.705973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.18.112.126:44033)
0810 03:12:42.706170 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:42.706178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:42.706500 (+ 322us) server_negotiation.cc:407] Connection header received
0810 03:12:42.706630 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:42.706635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:42.706694 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:42.706771 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:42.707745 (+ 974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50454: BlockingRecv error: recv got EOF from 127.0.0.1:50454 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:12:42.711162 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22695
W20260810 03:12:42.713620 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22695: Not authorized: Client connection negotiation failed: client connection to 127.18.112.65:43245: server requires authentication, but client does not have Kerberos credentials available
I20260810 03:12:42.713774 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 22695
I20260810 03:12:42.736824 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22898
W20260810 03:12:42.738971 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22898: Not authorized: Client connection negotiation failed: client connection to 127.18.112.66:41363: server requires authentication, but client does not have Kerberos credentials available
I20260810 03:12:42.739108 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 22898
I20260810 03:12:42.758751 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23091
W20260810 03:12:42.761396 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23091: Not authorized: Client connection negotiation failed: client connection to 127.18.112.67:45775: server requires authentication, but client does not have Kerberos credentials available
I20260810 03:12:42.761528 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 23091
I20260810 03:12:42.779064 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 22556
I20260810 03:12:42.780226 22652 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:42.885124 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 22556
2026-08-10T03:12:42Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3480 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[23303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[23303](info): set up 2 sockets
Aug 10 03:12:42 dist-test-slave-jlzn krb5kdc[23303](info): commencing operation
krb5kdc: starting...
W20260810 03:12:44.057163 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:44.236492 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:39505
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:39505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:44.541514 23325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:44.541782 23325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:44.541909 23325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:44.548794 23325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:44.548899 23325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:44.548974 23325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:44.549048 23325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:44.549113 23325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:44.558357 23325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:39505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:39505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:44.559477 23325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:44.560796 23325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:44.572100 23333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:44.572075 23336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:44.572140 23334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:44.573215 23325 server_base.cc:1034] running on GCE node
I20260810 03:12:44.573870 23325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:44.575032 23325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:44.576220 23325 hybrid_clock.cc:648] HybridClock initialized: now 1786331564576178 us; error 30 us; skew 500 ppm
I20260810 03:12:44.576520 23325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331564, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:44.583216 23325 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:44.584610 23325 webserver.cc:460] Webserver started at http://127.18.112.126:45403/ using document root <none> and password file <none>
I20260810 03:12:44.585206 23325 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:44.585306 23325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:44.585544 23325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:44.588335 23325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "e2e9a00139084ed0bd78117023794c52"
format_stamp: "Formatted at 2026-08-10 03:12:44 on dist-test-slave-jlzn"
server_key: "dcfe545be3af9db46a57a142d652e4ab"
server_key_iv: "b957ae2b7cd574641dc4ff62c3918d2a"
server_key_version: "encryptionkey@0"
I20260810 03:12:44.589035 23325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "e2e9a00139084ed0bd78117023794c52"
format_stamp: "Formatted at 2026-08-10 03:12:44 on dist-test-slave-jlzn"
server_key: "dcfe545be3af9db46a57a142d652e4ab"
server_key_iv: "b957ae2b7cd574641dc4ff62c3918d2a"
server_key_version: "encryptionkey@0"
I20260810 03:12:44.593714 23325 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:44.596787 23346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:44.597945 23325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:44.598101 23325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "e2e9a00139084ed0bd78117023794c52"
format_stamp: "Formatted at 2026-08-10 03:12:44 on dist-test-slave-jlzn"
server_key: "dcfe545be3af9db46a57a142d652e4ab"
server_key_iv: "b957ae2b7cd574641dc4ff62c3918d2a"
server_key_version: "encryptionkey@0"
I20260810 03:12:44.598276 23325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:44.620733 23325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:44.624577 23325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:44.624816 23325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:44.641256 23325 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:39505
I20260810 03:12:44.641290 23422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:39505 every 8 connection(s)
I20260810 03:12:44.642481 23325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:44.645936 23424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:44.650120 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 23325
I20260810 03:12:44.650372 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:44.651160 18881 external_mini_cluster.cc:1428] Setting key f6d47e71c985b79e407d8b68fc78ce81
I20260810 03:12:44.656908 23424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52: Bootstrap starting.
I20260810 03:12:44.660271 23424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:44.661412 23424 log.cc:824] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:44.664951 23424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52: No bootstrap required, opened a new log
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:44.672951 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:44.652897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.18.112.126:39505)
0810 03:12:44.653594 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:44.653604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:44.653653 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:12:44.655459 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:44.655480 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:44.655850 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:44.656153 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:44.657964 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:44.659250 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:44.660928 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:44.661595 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:44.661769 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:44.666209 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:44.666216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:44.666230 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:44.666265 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:44.669169 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:44.669923 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:44.669930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:44.669935 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:44.670101 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:44.670464 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:44.670467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:44.670469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:44.670977 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:44.671196 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:44.671623 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 03:12:44.672018 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":309,"threads_started":1}
I20260810 03:12:44.673697 23424 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } }
I20260810 03:12:44.674116 23424 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:44.674249 23424 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2e9a00139084ed0bd78117023794c52, State: Initialized, Role: FOLLOWER
I20260810 03:12:44.674769 23424 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } }
I20260810 03:12:44.674975 23424 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:44.675110 23424 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:44.675313 23424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:44.676653 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:12:44.677574 23424 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } }
I20260810 03:12:44.678002 23424 leader_election.cc:302] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2e9a00139084ed0bd78117023794c52; no voters:
I20260810 03:12:44.678541 23424 leader_election.cc:288] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:44.678673 23430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:44.680397 23424 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:44.685624 23430 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [term 1 LEADER]: Becoming Leader. State: Replica: e2e9a00139084ed0bd78117023794c52, State: Running, Role: LEADER
I20260810 03:12:44.686177 23430 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } }
I20260810 03:12:44.690593 23432 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2e9a00139084ed0bd78117023794c52. Latest consensus state: current_term: 1 leader_uuid: "e2e9a00139084ed0bd78117023794c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } } }
I20260810 03:12:44.690866 23432 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:44.691601 23456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:44.691433 23431 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2e9a00139084ed0bd78117023794c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2e9a00139084ed0bd78117023794c52" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39505 } } }
I20260810 03:12:44.691778 23431 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:44.698987 23456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:44.707839 23456 catalog_manager.cc:1347] Generated new cluster ID: ab24781444554186ad6f53d7d2fbb0bc
I20260810 03:12:44.707937 23456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:44.723109 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:44.714369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60142 (local address 127.18.112.126:39505)
0810 03:12:44.714548 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:44.714554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:44.715128 (+ 574us) server_negotiation.cc:407] Connection header received
0810 03:12:44.715303 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:44.715308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:44.715382 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:44.715476 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:44.716759 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:44.717901 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:44.719709 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:44.720350 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:44.720460 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:44.721584 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:44.721591 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:44.721596 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:44.722322 (+ 726us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:44.722393 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:44.722424 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:44.722520 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:44.722668 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 03:12:44.722757 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:12:44.730917 23456 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:44.732776 23456 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:44.746037 23456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2e9a00139084ed0bd78117023794c52: Generated new TSK 0
I20260810 03:12:44.746872 23456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:12:44.759161 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23325
I20260810 03:12:44.760228 23414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:44.848268 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 23325
2026-08-10T03:12:44Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1957 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23475](info): set up 2 sockets
Aug 10 03:12:44 dist-test-slave-jlzn krb5kdc[23475](info): commencing operation
krb5kdc: starting...
W20260810 03:12:46.011862 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:46 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:46.189321 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35235
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:45981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:46.493826 23491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:46.494118 23491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:46.494266 23491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:46.501164 23491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:46.501274 23491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:46.501353 23491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:46.501427 23491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:46.501488 23491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:46.510730 23491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:45981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:46.511958 23491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:46.513196 23491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:46.524307 23497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:46.524346 23498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:46.524279 23500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:46.525283 23491 server_base.cc:1034] running on GCE node
I20260810 03:12:46.525986 23491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:46.527264 23491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:46.528471 23491 hybrid_clock.cc:648] HybridClock initialized: now 1786331566528425 us; error 26 us; skew 500 ppm
I20260810 03:12:46.528787 23491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:46 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331566, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:46.531675 23491 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:46.533034 23491 webserver.cc:460] Webserver started at http://127.18.112.126:41611/ using document root <none> and password file <none>
I20260810 03:12:46.533653 23491 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:46.533771 23491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:46.534051 23491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:46.536878 23491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d"
format_stamp: "Formatted at 2026-08-10 03:12:46 on dist-test-slave-jlzn"
server_key: "5dc9b427bc420fe687d50a0ded7167d5"
server_key_iv: "121964bb7bac734739d98ba52f6b19bf"
server_key_version: "encryptionkey@0"
I20260810 03:12:46.537590 23491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d"
format_stamp: "Formatted at 2026-08-10 03:12:46 on dist-test-slave-jlzn"
server_key: "5dc9b427bc420fe687d50a0ded7167d5"
server_key_iv: "121964bb7bac734739d98ba52f6b19bf"
server_key_version: "encryptionkey@0"
I20260810 03:12:46.542424 23491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:12:46.545552 23513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:46.546758 23491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:12:46.546940 23491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d"
format_stamp: "Formatted at 2026-08-10 03:12:46 on dist-test-slave-jlzn"
server_key: "5dc9b427bc420fe687d50a0ded7167d5"
server_key_iv: "121964bb7bac734739d98ba52f6b19bf"
server_key_version: "encryptionkey@0"
I20260810 03:12:46.547106 23491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:46.566228 23491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:46.569813 23491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:46.570052 23491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:46.586570 23491 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35235
I20260810 03:12:46.586606 23592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35235 every 8 connection(s)
I20260810 03:12:46.587785 23491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:46.591241 23593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:46.593029 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 23491
I20260810 03:12:46.593231 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:46.593840 18881 external_mini_cluster.cc:1428] Setting key 77e39e0d966825ccadff2027c75b4dff
I20260810 03:12:46.603518 23593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d: Bootstrap starting.
I20260810 03:12:46.606884 23593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:46.607916 23593 log.cc:824] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:12:46 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:46.611233 23593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d: No bootstrap required, opened a new log
I20260810 03:12:46.617396 23597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:46.595747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57236 (local address 127.18.112.126:35235)
0810 03:12:46.596568 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:46.596583 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:46.596652 (+ 69us) server_negotiation.cc:407] Connection header received
0810 03:12:46.598854 (+ 2202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:46.598881 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:46.599339 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:46.599769 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:46.600962 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:46.602890 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:46.604156 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:46.605167 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:46.605353 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:46.609392 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:46.609402 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:46.609419 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:46.609459 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:46.613178 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:46.613829 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:46.613837 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:46.613845 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:46.614055 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:46.614391 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:46.614396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:46.614400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:46.615094 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:46.615417 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:46.615695 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:12:46.616120 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":312,"threads_started":1}
I20260810 03:12:46.620955 23593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } }
I20260810 03:12:46.621269 23593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:46.621341 23593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb9a071bcb44e8d988b3f7ffea70f0d, State: Initialized, Role: FOLLOWER
I20260810 03:12:46.621809 23593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } }
I20260810 03:12:46.621997 23593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:46.622092 23593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:46.622215 23593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:46.624475 23593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } }
I20260810 03:12:46.624902 23593 leader_election.cc:302] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fb9a071bcb44e8d988b3f7ffea70f0d; no voters:
I20260810 03:12:46.625375 23593 leader_election.cc:288] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:46.625488 23599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:46.626761 23599 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [term 1 LEADER]: Becoming Leader. State: Replica: 7fb9a071bcb44e8d988b3f7ffea70f0d, State: Running, Role: LEADER
I20260810 03:12:46.627219 23599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } }
I20260810 03:12:46.627523 23593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:46.629714 23602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fb9a071bcb44e8d988b3f7ffea70f0d. Latest consensus state: current_term: 1 leader_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } } }
I20260810 03:12:46.629738 23600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb9a071bcb44e8d988b3f7ffea70f0d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35235 } } }
I20260810 03:12:46.630117 23600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:46.630093 23602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:46.632777 23611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:46.637504 23611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:46.645321 23611 catalog_manager.cc:1347] Generated new cluster ID: 909d319e8dc045a589ee0f47c6f699e5
I20260810 03:12:46.645421 23611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:46.668962 23611 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:46.670184 23611 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:46.687072 23611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fb9a071bcb44e8d988b3f7ffea70f0d: Generated new TSK 0
I20260810 03:12:46.687793 23611 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:46.739411 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:45981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:47.049729 23631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:47.050012 23631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:47.050150 23631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:47.057158 23631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:47.057269 23631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:47.057404 23631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:47.066397 23631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:45981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:47.067495 23631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:47.068740 23631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:47.080572 23638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:47.080633 23640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:47.080792 23642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:47.081715 23631 server_base.cc:1034] running on GCE node
I20260810 03:12:47.082290 23631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:47.083138 23631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:47.084339 23631 hybrid_clock.cc:648] HybridClock initialized: now 1786331567084297 us; error 35 us; skew 500 ppm
I20260810 03:12:47.084645 23631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:47 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331567, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:47.087613 23631 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:47.088946 23631 webserver.cc:460] Webserver started at http://127.18.112.65:41347/ using document root <none> and password file <none>
I20260810 03:12:47.089573 23631 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:47.089690 23631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:47.089991 23631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:47.092774 23631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "89bef469210e4563baf50da98004a47e"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "9d54d69a12cb079ddb2726c453e5a017"
server_key_iv: "28668cb2d6f015730c6db6939f87457a"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.093508 23631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "89bef469210e4563baf50da98004a47e"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "9d54d69a12cb079ddb2726c453e5a017"
server_key_iv: "28668cb2d6f015730c6db6939f87457a"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.098223 23631 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:12:47.102067 23658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.103300 23631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:12:47.103451 23631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "89bef469210e4563baf50da98004a47e"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "9d54d69a12cb079ddb2726c453e5a017"
server_key_iv: "28668cb2d6f015730c6db6939f87457a"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.103621 23631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:47.129443 23631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:47.133522 23631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:47.133786 23631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:47.134634 23631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:47.135931 23631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:47.136004 23631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.136116 23631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:47.136168 23631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.164130 23631 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:43269
I20260810 03:12:47.164179 23814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:43269 every 8 connection(s)
I20260810 03:12:47.165349 23631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:47.175699 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 23631
I20260810 03:12:47.175936 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:47.176565 18881 external_mini_cluster.cc:1428] Setting key b77efcb038e12db7f10d0cee79cf8a3d
Aug 10 03:12:47 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331567, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:47.183773 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:47.167700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:59551 (local address 127.18.112.126:35235)
0810 03:12:47.168178 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:47.168184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:47.169133 (+ 949us) server_negotiation.cc:407] Connection header received
0810 03:12:47.170833 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:47.170837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:47.170904 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:47.171003 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:47.172405 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.173156 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.174570 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.174952 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.175038 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:47.178415 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:47.178420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:47.178423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:47.178454 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:47.180882 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:47.181698 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:47.181701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:47.181703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:47.181820 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:47.182240 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:47.182243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:47.182244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:47.182492 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:47.182597 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:47.183336 (+ 739us) server_negotiation.cc:299] Negotiation successful
0810 03:12:47.183506 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":232,"threads_started":1}
I20260810 03:12:47.185048 23824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:47.168277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35235 (local address 127.18.112.65:59551)
0810 03:12:47.168959 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:47.168995 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:47.170600 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:47.171183 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:47.171190 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:47.171675 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:47.172274 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:47.172291 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.173263 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.173267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:47.174468 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:47.174479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.175108 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.175113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:47.175320 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:47.176005 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:47.176030 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:47.178208 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:47.181024 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:47.181032 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:47.181051 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:47.181586 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:47.181910 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:47.181914 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:47.181917 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:47.182148 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:47.182606 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:47.182615 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:47.183004 (+ 389us) client_negotiation.cc:769] Sending connection context
0810 03:12:47.183273 (+ 269us) client_negotiation.cc:240] Negotiation successful
0810 03:12:47.183770 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":267,"threads_started":1}
I20260810 03:12:47.186538 23817 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35235
I20260810 03:12:47.186852 23817 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:47.187536 23817 heartbeater.cc:511] Master 127.18.112.126:35235 requested a full tablet report, sending...
I20260810 03:12:47.189673 23542 ts_manager.cc:194] Registered new tserver with Master: 89bef469210e4563baf50da98004a47e (127.18.112.65:43269)
I20260810 03:12:47.191028 23542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:59551
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:47.219779 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:45981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:47.526393 23827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:47.526672 23827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:47.526814 23827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:47.533769 23827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:47.533878 23827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:47.534018 23827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:47.543135 23827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:45981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:47.544544 23827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:47.545763 23827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:47.557761 23835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:47.557813 23836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:47.557834 23838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:47.558676 23827 server_base.cc:1034] running on GCE node
I20260810 03:12:47.559249 23827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:47.560117 23827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:47.561312 23827 hybrid_clock.cc:648] HybridClock initialized: now 1786331567561269 us; error 39 us; skew 500 ppm
I20260810 03:12:47.561590 23827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:47 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331567, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:47.564543 23827 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:47.565900 23827 webserver.cc:460] Webserver started at http://127.18.112.66:37951/ using document root <none> and password file <none>
I20260810 03:12:47.566550 23827 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:47.566680 23827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:47.566964 23827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:47.569975 23827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "02505bc42ef04791b537bba2846462de"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "85f7554da97a936fa3bebe142522da45"
server_key_iv: "138c7c4f006fc12db7cc1e08e9f0cbbf"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.570734 23827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "02505bc42ef04791b537bba2846462de"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "85f7554da97a936fa3bebe142522da45"
server_key_iv: "138c7c4f006fc12db7cc1e08e9f0cbbf"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.575594 23827 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 03:12:47.579090 23849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.580323 23827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:12:47.580472 23827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "02505bc42ef04791b537bba2846462de"
format_stamp: "Formatted at 2026-08-10 03:12:47 on dist-test-slave-jlzn"
server_key: "85f7554da97a936fa3bebe142522da45"
server_key_iv: "138c7c4f006fc12db7cc1e08e9f0cbbf"
server_key_version: "encryptionkey@0"
I20260810 03:12:47.580649 23827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:47.591401 23827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:47.595338 23827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:47.595603 23827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:47.596516 23827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:47.597756 23827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:47.597831 23827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.597949 23827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:47.598002 23827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:47.626845 23827 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:36221
I20260810 03:12:47.626888 24019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:36221 every 8 connection(s)
I20260810 03:12:47.628135 23827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:47.634828 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 23827
I20260810 03:12:47.635035 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:47.635555 18881 external_mini_cluster.cc:1428] Setting key afdd7f678350b9458994943e0f08f06f
Aug 10 03:12:47 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331567, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:47.648020 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:47.630536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:49569 (local address 127.18.112.126:35235)
0810 03:12:47.630718 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:47.630723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:47.631884 (+ 1161us) server_negotiation.cc:407] Connection header received
0810 03:12:47.633612 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:47.633618 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:47.633705 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:47.633791 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:47.635566 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.636466 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.638487 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.639050 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.639178 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:47.642321 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:47.642326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:47.642331 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:47.642365 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:47.645039 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:47.645937 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:47.645941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:47.645944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:47.646074 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:47.646503 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:47.646506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:47.646508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:47.646747 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:47.646857 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:47.647566 (+ 709us) server_negotiation.cc:299] Negotiation successful
0810 03:12:47.647744 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:12:47.649263 24024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:47.630995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35235 (local address 127.18.112.66:49569)
0810 03:12:47.631714 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:47.631757 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:47.633361 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:47.634025 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:47.634033 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:47.634618 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:47.635398 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:47.635424 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.636614 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.636619 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:47.638335 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:47.638357 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:47.639234 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:47.639239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:47.639424 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:47.640050 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:47.640072 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:47.642118 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:47.645178 (+ 3060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:47.645187 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:47.645206 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:47.645827 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:47.646179 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:47.646184 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:47.646188 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:47.646415 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:47.646854 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:47.646862 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:47.647247 (+ 385us) client_negotiation.cc:769] Sending connection context
0810 03:12:47.647517 (+ 270us) client_negotiation.cc:240] Negotiation successful
0810 03:12:47.648041 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":263,"threads_started":1}
I20260810 03:12:47.650533 24021 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35235
I20260810 03:12:47.650817 24021 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:47.651561 24021 heartbeater.cc:511] Master 127.18.112.126:35235 requested a full tablet report, sending...
I20260810 03:12:47.653024 23542 ts_manager.cc:194] Registered new tserver with Master: 02505bc42ef04791b537bba2846462de (127.18.112.66:36221)
I20260810 03:12:47.654125 23542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:49569
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:47.680363 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:45981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:47.989473 24028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:47.989768 24028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:47.989872 24028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:47.997130 24028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:47.997227 24028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:47.997339 24028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:48.006431 24028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:45981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35235
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:48.007589 24028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:48.008831 24028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:48.021461 24034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:48.021517 24035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:48.021546 24037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:48.022296 24028 server_base.cc:1034] running on GCE node
I20260810 03:12:48.022852 24028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:48.023721 24028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:48.024925 24028 hybrid_clock.cc:648] HybridClock initialized: now 1786331568024871 us; error 41 us; skew 500 ppm
I20260810 03:12:48.025215 24028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:48.028141 24028 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:48.029451 24028 webserver.cc:460] Webserver started at http://127.18.112.67:36535/ using document root <none> and password file <none>
I20260810 03:12:48.030059 24028 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:48.030184 24028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:48.030460 24028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:48.033221 24028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "4bb24b82404e44e39acd43fb8f6c00a4"
format_stamp: "Formatted at 2026-08-10 03:12:48 on dist-test-slave-jlzn"
server_key: "9359c97d002463d4cfc19fe2a5323d10"
server_key_iv: "9379dc0dc18f64dc346a26d9deb8fd11"
server_key_version: "encryptionkey@0"
I20260810 03:12:48.033946 24028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "4bb24b82404e44e39acd43fb8f6c00a4"
format_stamp: "Formatted at 2026-08-10 03:12:48 on dist-test-slave-jlzn"
server_key: "9359c97d002463d4cfc19fe2a5323d10"
server_key_iv: "9379dc0dc18f64dc346a26d9deb8fd11"
server_key_version: "encryptionkey@0"
I20260810 03:12:48.038664 24028 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 03:12:48.041873 24051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:48.043051 24028 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:48.043207 24028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "4bb24b82404e44e39acd43fb8f6c00a4"
format_stamp: "Formatted at 2026-08-10 03:12:48 on dist-test-slave-jlzn"
server_key: "9359c97d002463d4cfc19fe2a5323d10"
server_key_iv: "9379dc0dc18f64dc346a26d9deb8fd11"
server_key_version: "encryptionkey@0"
I20260810 03:12:48.043375 24028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:48.073101 24028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:48.076839 24028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:48.077099 24028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:48.077971 24028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:48.079221 24028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:48.079298 24028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:48.079418 24028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:48.079480 24028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:48.110107 24028 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:34881
I20260810 03:12:48.110152 24223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:34881 every 8 connection(s)
I20260810 03:12:48.111330 24028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:48.115628 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 24028
I20260810 03:12:48.115842 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:48.116376 18881 external_mini_cluster.cc:1428] Setting key b973e3572a0e49fee5ebb5c88f18173a
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:48.130148 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.113667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:57635 (local address 127.18.112.126:35235)
0810 03:12:48.113886 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:48.113892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:48.114964 (+ 1072us) server_negotiation.cc:407] Connection header received
0810 03:12:48.117235 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:48.117240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:48.117314 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:48.117398 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:48.119071 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.119927 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.121414 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.121840 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.121932 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.125132 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:48.125137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:48.125140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:48.125181 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:48.127471 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.128177 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.128181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.128183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.128297 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.128659 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.128662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.128666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.128956 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:48.129059 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:48.129636 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 03:12:48.129854 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:12:48.131229 24227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.114140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35235 (local address 127.18.112.67:57635)
0810 03:12:48.114813 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:48.114856 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:48.116979 (+ 2123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:48.117614 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:48.117626 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:48.118310 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:48.118916 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:48.118932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.120095 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.120099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:48.121297 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:48.121309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.122024 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.122031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:48.122240 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.122825 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:48.122847 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:48.124941 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:48.127592 (+ 2651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:48.127598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:48.127608 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:48.128084 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:48.128374 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:48.128377 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:48.128379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:48.128577 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:48.129048 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:48.129053 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:48.129328 (+ 275us) client_negotiation.cc:769] Sending connection context
0810 03:12:48.129553 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 03:12:48.129992 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":263,"threads_started":1}
I20260810 03:12:48.132503 24224 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35235
I20260810 03:12:48.132746 24224 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:48.133373 24224 heartbeater.cc:511] Master 127.18.112.126:35235 requested a full tablet report, sending...
I20260810 03:12:48.134652 23542 ts_manager.cc:194] Registered new tserver with Master: 4bb24b82404e44e39acd43fb8f6c00a4 (127.18.112.67:34881)
I20260810 03:12:48.135577 23542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:57635
I20260810 03:12:48.143321 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:48.190438 23822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.178080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57250 (local address 127.18.112.126:35235)
0810 03:12:48.178302 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:48.178309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:48.178644 (+ 335us) server_negotiation.cc:407] Connection header received
0810 03:12:48.178791 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:48.178794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:48.178856 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:48.178929 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:48.180207 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.180917 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.182049 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.182433 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.182518 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.186015 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:48.186020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:48.186023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:48.186054 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:48.188328 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.188880 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.188884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.188886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.189004 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.189331 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.189334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.189336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.189620 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:48.189799 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:48.189994 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 03:12:48.190151 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260810 03:12:48.190940 23542 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57250
I20260810 03:12:48.192441 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23631
I20260810 03:12:48.193792 23817 heartbeater.cc:503] Master 127.18.112.126:35235 was elected leader, sending a full tablet report...
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:48.206579 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.193303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34540 (local address 127.18.112.65:43269)
0810 03:12:48.193860 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:48.193867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:48.193892 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:12:48.193962 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:48.193968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:48.194149 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:48.194337 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:48.195624 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.196623 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.197735 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.198254 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.198348 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.201783 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:48.201794 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:48.201806 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:48.201843 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:48.204508 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.205003 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.205008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.205010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.205128 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.205379 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.205382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.205383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.205685 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:48.205897 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:48.206050 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 03:12:48.206241 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":260,"threads_started":1}
W20260810 03:12:48.207698 23808 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34540
W20260810 03:12:48.208714 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23631: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:48.208877 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 23631
I20260810 03:12:48.233945 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23827
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:48.248665 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.234783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48042 (local address 127.18.112.66:36221)
0810 03:12:48.235257 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:48.235264 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:48.235288 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:12:48.235344 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:48.235350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:48.235545 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:48.235675 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:48.236822 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.237828 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.238929 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.239445 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.239542 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.243201 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:48.243211 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:48.243224 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:48.243255 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:48.246036 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.246636 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.246644 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.246646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.246790 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.247137 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.247140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.247143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.247458 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:48.247770 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:48.248102 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 03:12:48.248366 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":216,"threads_started":1}
W20260810 03:12:48.249817 24005 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48042
W20260810 03:12:48.250837 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23827: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:48.250985 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 23827
I20260810 03:12:48.269327 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24028
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[23475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331568, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:48.283667 24245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:48.270087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36936 (local address 127.18.112.67:34881)
0810 03:12:48.270629 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:48.270636 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:48.270664 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:12:48.270719 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:48.270724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:48.270910 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:48.271045 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:48.272342 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.273350 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.274539 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:48.275065 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:48.275232 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:48.279045 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:48.279056 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:48.279068 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:48.279100 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:48.281525 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.282089 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.282095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.282097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.282218 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:48.282465 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:48.282467 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:48.282469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:48.282772 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:48.282997 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:48.283204 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 03:12:48.283393 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":243,"threads_started":1}
W20260810 03:12:48.285005 24218 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36936
W20260810 03:12:48.285979 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24028: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:12:48.286096 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 24028
I20260810 03:12:48.309880 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 23491
I20260810 03:12:48.310936 23587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:48.410447 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 23491
2026-08-10T03:12:48Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3565 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[24250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[24250](info): set up 2 sockets
Aug 10 03:12:48 dist-test-slave-jlzn krb5kdc[24250](info): commencing operation
krb5kdc: starting...
W20260810 03:12:49.594357 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:49 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:49.785028 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35275
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:50.091931 24264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:50.092221 24264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:50.092351 24264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:50.099300 24264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:50.099406 24264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:50.099485 24264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:50.099561 24264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:50.099619 24264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:50.109817 24264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:50.111232 24264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:50.112520 24264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:50.123348 24269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:50.123391 24273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:50.123435 24270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:50.129007 24264 server_base.cc:1034] running on GCE node
I20260810 03:12:50.129714 24264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:50.130964 24264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:50.132164 24264 hybrid_clock.cc:648] HybridClock initialized: now 1786331570132109 us; error 36 us; skew 500 ppm
I20260810 03:12:50.132478 24264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:50 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331570, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:50.139048 24264 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:50.140527 24264 webserver.cc:460] Webserver started at http://127.18.112.126:41099/ using document root <none> and password file <none>
I20260810 03:12:50.141201 24264 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:50.141325 24264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:50.141618 24264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:50.144531 24264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "7c6087953cee47e9b46982bce36cf895"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "63bc13824d534c23efd27b311e53763a"
server_key_iv: "bc2621cf7b9553ea3702a1ed9a2343e4"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.145293 24264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "7c6087953cee47e9b46982bce36cf895"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "63bc13824d534c23efd27b311e53763a"
server_key_iv: "bc2621cf7b9553ea3702a1ed9a2343e4"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.150259 24264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 03:12:50.153571 24288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:50.154791 24264 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:12:50.154958 24264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "7c6087953cee47e9b46982bce36cf895"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "63bc13824d534c23efd27b311e53763a"
server_key_iv: "bc2621cf7b9553ea3702a1ed9a2343e4"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.155140 24264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:50.177071 24264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:50.180909 24264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:50.181181 24264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:50.197945 24264 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35275
I20260810 03:12:50.197965 24370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35275 every 8 connection(s)
I20260810 03:12:50.199195 24264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:50.199726 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 24264
I20260810 03:12:50.199936 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:50.200855 18881 external_mini_cluster.cc:1428] Setting key 499639a867796609c5f8511b34795c10
I20260810 03:12:50.203421 24373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:50.213475 24373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895: Bootstrap starting.
Aug 10 03:12:50 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:50.216665 24373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:50.217669 24373 log.cc:824] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:50.220413 24373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895: No bootstrap required, opened a new log
I20260810 03:12:50.221834 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:50.202790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.18.112.126:35275)
0810 03:12:50.203598 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:50.203609 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:50.203650 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:12:50.205314 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:50.205334 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:50.205686 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:50.206046 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:50.207497 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.208852 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.210086 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.210769 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.210941 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:50.214775 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:50.214783 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:50.214799 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:50.214833 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:50.217818 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:50.218577 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:50.218584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:50.218590 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:50.218769 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:50.219164 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:50.219169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:50.219177 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:50.219690 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:50.219987 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:50.220430 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 03:12:50.220804 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":340,"threads_started":1}
I20260810 03:12:50.228137 24373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } }
I20260810 03:12:50.228463 24373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:50.228557 24373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c6087953cee47e9b46982bce36cf895, State: Initialized, Role: FOLLOWER
I20260810 03:12:50.229084 24373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } }
I20260810 03:12:50.229297 24373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:50.229419 24373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:50.229576 24373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:50.231889 24373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } }
I20260810 03:12:50.232340 24373 leader_election.cc:302] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c6087953cee47e9b46982bce36cf895; no voters:
I20260810 03:12:50.232877 24373 leader_election.cc:288] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:50.233000 24378 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:50.233616 24378 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [term 1 LEADER]: Becoming Leader. State: Replica: 7c6087953cee47e9b46982bce36cf895, State: Running, Role: LEADER
I20260810 03:12:50.234153 24378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } }
I20260810 03:12:50.234771 24373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:50.236650 24379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c6087953cee47e9b46982bce36cf895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } } }
I20260810 03:12:50.236707 24381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c6087953cee47e9b46982bce36cf895. Latest consensus state: current_term: 1 leader_uuid: "7c6087953cee47e9b46982bce36cf895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c6087953cee47e9b46982bce36cf895" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35275 } } }
I20260810 03:12:50.237052 24379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:50.237200 24381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:50.237963 24388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:50.243315 24388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:50.251991 24388 catalog_manager.cc:1347] Generated new cluster ID: 081b9a6a6c1d4d87a719a537db1ee908
I20260810 03:12:50.252100 24388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:50.265084 24388 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:50.266279 24388 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:50.274319 24388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c6087953cee47e9b46982bce36cf895: Generated new TSK 0
I20260810 03:12:50.275198 24388 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:50.331205 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:50.641481 24406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:50.641758 24406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:50.641889 24406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:50.648836 24406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:50.648941 24406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:50.649089 24406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:50.658162 24406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:50.659291 24406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:50.660507 24406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:50.672387 24413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:50.672431 24414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:50.672742 24418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:50.673425 24406 server_base.cc:1034] running on GCE node
I20260810 03:12:50.673938 24406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:50.674748 24406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:50.675891 24406 hybrid_clock.cc:648] HybridClock initialized: now 1786331570675849 us; error 35 us; skew 500 ppm
I20260810 03:12:50.676177 24406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:50 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331570, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:50.679059 24406 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:50.680365 24406 webserver.cc:460] Webserver started at http://127.18.112.65:44273/ using document root <none> and password file <none>
I20260810 03:12:50.680969 24406 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:50.681083 24406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:50.681360 24406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:50.684056 24406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "ef74a16a545b4cfabcb12474cf0949ee"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "4aacc786744b90139253a4f0590fab63"
server_key_iv: "8bd1db731a80874e727e942983a1c17a"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.684883 24406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "ef74a16a545b4cfabcb12474cf0949ee"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "4aacc786744b90139253a4f0590fab63"
server_key_iv: "8bd1db731a80874e727e942983a1c17a"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.689509 24406 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:50.692660 24430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:50.693825 24406 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:50.693980 24406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "ef74a16a545b4cfabcb12474cf0949ee"
format_stamp: "Formatted at 2026-08-10 03:12:50 on dist-test-slave-jlzn"
server_key: "4aacc786744b90139253a4f0590fab63"
server_key_iv: "8bd1db731a80874e727e942983a1c17a"
server_key_version: "encryptionkey@0"
I20260810 03:12:50.694154 24406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:50.710492 24406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:50.714282 24406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:50.714504 24406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:50.715309 24406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:50.716600 24406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:50.716675 24406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:50.716768 24406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:50.716810 24406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:50.745967 24406 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:42095
I20260810 03:12:50.746008 24591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:42095 every 8 connection(s)
I20260810 03:12:50.747159 24406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:50.748088 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 24406
I20260810 03:12:50.748450 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:50.749192 18881 external_mini_cluster.cc:1428] Setting key 6086edac5e61ba39b8798eda73258149
Aug 10 03:12:50 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331570, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:50.767017 24594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:50.749608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:60677 (local address 127.18.112.126:35275)
0810 03:12:50.750027 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:50.750033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:50.751174 (+ 1141us) server_negotiation.cc:407] Connection header received
0810 03:12:50.753034 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:50.753040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:50.753121 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:50.753248 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:50.754671 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.755666 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.757564 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.758121 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.758229 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:50.761712 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:50.761716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:50.761719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:50.761751 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:50.764111 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:50.764778 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:50.764782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:50.764784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:50.764903 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:50.765376 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:50.765379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:50.765382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:50.765654 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:50.765784 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:50.766434 (+ 650us) server_negotiation.cc:299] Negotiation successful
0810 03:12:50.766657 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":215,"threads_started":1}
I20260810 03:12:50.767920 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:50.750231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35275 (local address 127.18.112.65:60677)
0810 03:12:50.751000 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:50.751045 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:50.752772 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:50.753440 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:50.753447 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:50.753942 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:50.754490 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:50.754508 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.755838 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.755843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:50.757416 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:50.757430 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:50.758350 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:50.758357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:50.758625 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:50.759330 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:50.759358 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:50.761505 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:50.764239 (+ 2734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:50.764249 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:50.764263 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:50.764655 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:50.765004 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:50.765009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:50.765013 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:50.765264 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:50.765778 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:50.765785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:50.766087 (+ 302us) client_negotiation.cc:769] Sending connection context
0810 03:12:50.766321 (+ 234us) client_negotiation.cc:240] Negotiation successful
0810 03:12:50.766794 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":309,"threads_started":1}
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:12:50.769389 24592 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35275
I20260810 03:12:50.769667 24592 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:50.770359 24592 heartbeater.cc:511] Master 127.18.112.126:35275 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
I20260810 03:12:50.772621 24313 ts_manager.cc:194] Registered new tserver with Master: ef74a16a545b4cfabcb12474cf0949ee (127.18.112.65:42095)
I20260810 03:12:50.774587 24313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:60677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:50.793917 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:51.103386 24600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:51.103662 24600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:51.103819 24600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:51.110746 24600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:51.110869 24600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:51.111030 24600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:51.121135 24600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:51.122292 24600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:51.123504 24600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:51.135922 24607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:51.135950 24610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:51.135980 24608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:51.136736 24600 server_base.cc:1034] running on GCE node
I20260810 03:12:51.137249 24600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:51.138027 24600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:51.139232 24600 hybrid_clock.cc:648] HybridClock initialized: now 1786331571139179 us; error 47 us; skew 500 ppm
I20260810 03:12:51.139539 24600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:51.142540 24600 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:51.143862 24600 webserver.cc:460] Webserver started at http://127.18.112.66:35443/ using document root <none> and password file <none>
I20260810 03:12:51.144484 24600 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:51.144599 24600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:51.144884 24600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:51.147533 24600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "3689bf3adb52474988fc696f0ac1760a"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "d2041e6e25ddb43e89aeab7d77605b92"
server_key_iv: "fb4f48e2f161024353582daadc07e482"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.148311 24600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "3689bf3adb52474988fc696f0ac1760a"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "d2041e6e25ddb43e89aeab7d77605b92"
server_key_iv: "fb4f48e2f161024353582daadc07e482"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.153034 24600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:12:51.156209 24622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.157366 24600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260810 03:12:51.157512 24600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "3689bf3adb52474988fc696f0ac1760a"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "d2041e6e25ddb43e89aeab7d77605b92"
server_key_iv: "fb4f48e2f161024353582daadc07e482"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.157686 24600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:51.176781 24600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:51.180764 24600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:51.181012 24600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:51.181874 24600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:51.183089 24600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:51.183182 24600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.183295 24600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:51.183346 24600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.218178 24600 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:40441
I20260810 03:12:51.218231 24800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:40441 every 8 connection(s)
I20260810 03:12:51.219338 24600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:51.229496 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 24600
I20260810 03:12:51.229664 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:51.230199 18881 external_mini_cluster.cc:1428] Setting key f82e34440ff79e14a38481575d4a71b8
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:51.238174 24594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.221627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:36303 (local address 127.18.112.126:35275)
0810 03:12:51.221804 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.221809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.222915 (+ 1106us) server_negotiation.cc:407] Connection header received
0810 03:12:51.224759 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.224763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.224828 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.224913 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.226247 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.226967 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.228455 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.228842 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.228930 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.232805 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.232810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.232813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.232844 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.235296 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.236075 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.236079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.236081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.236217 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.236610 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.236614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.236616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.236869 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.237000 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.237638 (+ 638us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.237857 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:12:51.238999 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.222080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35275 (local address 127.18.112.66:36303)
0810 03:12:51.222766 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:51.222802 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:51.224531 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:51.225092 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:51.225099 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:51.225595 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:51.226108 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:51.226125 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.227080 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.227083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:51.228343 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:51.228354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.229003 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.229008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:51.229246 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.229939 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:51.229968 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:51.232609 (+ 2641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:51.235420 (+ 2811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:51.235429 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:51.235443 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:51.235963 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:51.236319 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:51.236324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:51.236328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:51.236500 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:51.236989 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:51.236997 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:51.237295 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 03:12:51.237511 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 03:12:51.237971 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":257,"threads_started":1}
I20260810 03:12:51.240389 24803 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35275
I20260810 03:12:51.240688 24803 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:51.241341 24803 heartbeater.cc:511] Master 127.18.112.126:35275 requested a full tablet report, sending...
I20260810 03:12:51.242671 24313 ts_manager.cc:194] Registered new tserver with Master: 3689bf3adb52474988fc696f0ac1760a (127.18.112.66:40441)
I20260810 03:12:51.243433 24313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:36303
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:51.273885 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:51.586196 24811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:51.586457 24811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:51.586567 24811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:51.593422 24811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:51.593524 24811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:51.593643 24811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:51.602808 24811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:51.603945 24811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:51.605150 24811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:51.617084 24819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:51.617136 24820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:51.617165 24823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:51.617857 24811 server_base.cc:1034] running on GCE node
I20260810 03:12:51.618405 24811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:51.619228 24811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:51.620414 24811 hybrid_clock.cc:648] HybridClock initialized: now 1786331571620370 us; error 34 us; skew 500 ppm
I20260810 03:12:51.620695 24811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:51.623466 24811 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:51.624751 24811 webserver.cc:460] Webserver started at http://127.18.112.67:33457/ using document root <none> and password file <none>
I20260810 03:12:51.625344 24811 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:51.625459 24811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:51.625739 24811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:51.628396 24811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "783c38ba49ab4363ac87ca45748bc546"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "6bd038587646c2328d6e4f4db92499db"
server_key_iv: "90bda6989cebc9a46eb83a03eb129759"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.629128 24811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "783c38ba49ab4363ac87ca45748bc546"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "6bd038587646c2328d6e4f4db92499db"
server_key_iv: "90bda6989cebc9a46eb83a03eb129759"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.633788 24811 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260810 03:12:51.636987 24838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.638149 24811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:51.638296 24811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "783c38ba49ab4363ac87ca45748bc546"
format_stamp: "Formatted at 2026-08-10 03:12:51 on dist-test-slave-jlzn"
server_key: "6bd038587646c2328d6e4f4db92499db"
server_key_iv: "90bda6989cebc9a46eb83a03eb129759"
server_key_version: "encryptionkey@0"
I20260810 03:12:51.638469 24811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:51.654265 24811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:51.657841 24811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:51.658082 24811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:51.658994 24811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:51.660297 24811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:51.660375 24811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.660496 24811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:51.660548 24811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:51.690094 24811 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:39449
I20260810 03:12:51.690145 24994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:39449 every 8 connection(s)
I20260810 03:12:51.691275 24811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:51.700040 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 24811
I20260810 03:12:51.700194 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:51.700608 18881 external_mini_cluster.cc:1428] Setting key 41fa12725c6ce818a7446567930eb3f1
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:51.709893 24594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.693608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:46413 (local address 127.18.112.126:35275)
0810 03:12:51.693784 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.693789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.694875 (+ 1086us) server_negotiation.cc:407] Connection header received
0810 03:12:51.696679 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.696684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.696752 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.696835 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.698298 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.699066 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.700689 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.701243 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.701363 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.705166 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.705171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.705174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.705206 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.707465 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.708146 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.708150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.708152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.708271 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.708604 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.708606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.708608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.708860 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.708966 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.709488 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.709661 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:12:51.710749 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.694040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35275 (local address 127.18.112.67:46413)
0810 03:12:51.694720 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:51.694756 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:51.696438 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:51.697050 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:51.697058 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:51.697596 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:51.698139 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:51.698157 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.699211 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.699215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:51.700541 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:51.700554 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.701447 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.701452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:51.701712 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.702413 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:51.702450 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:51.704960 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:51.707593 (+ 2633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:51.707599 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:51.707608 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:51.708053 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:51.708349 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:51.708352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:51.708354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:51.708524 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:51.708949 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:51.708953 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:51.709223 (+ 270us) client_negotiation.cc:769] Sending connection context
0810 03:12:51.709420 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 03:12:51.709758 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":252,"threads_started":1}
I20260810 03:12:51.711920 24995 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35275
I20260810 03:12:51.712179 24995 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:51.712841 24995 heartbeater.cc:511] Master 127.18.112.126:35275 requested a full tablet report, sending...
I20260810 03:12:51.714098 24313 ts_manager.cc:194] Registered new tserver with Master: 783c38ba49ab4363ac87ca45748bc546 (127.18.112.67:39449)
I20260810 03:12:51.714882 24313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:46413
I20260810 03:12:51.715708 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:51.764449 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.750387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.18.112.65:42095)
0810 03:12:51.751161 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.751167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.751276 (+ 109us) server_negotiation.cc:407] Connection header received
0810 03:12:51.751421 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.751427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.751610 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.751747 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.753136 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.754105 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.755231 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.755781 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.755911 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.759448 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.759458 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.759471 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.759500 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.762143 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.762750 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.762756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.762759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.762883 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.763137 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.763140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.763142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.763451 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.763670 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.763906 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.764089 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":330,"threads_started":1}
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:51.778074 24592 heartbeater.cc:503] Master 127.18.112.126:35275 was elected leader, sending a full tablet report...
I20260810 03:12:51.780853 24594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.768180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37030 (local address 127.18.112.126:35275)
0810 03:12:51.768372 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.768378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.768569 (+ 191us) server_negotiation.cc:407] Connection header received
0810 03:12:51.768720 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.768725 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.768794 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.768871 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.770025 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.770754 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.771994 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.772410 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.772519 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.775954 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.775959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.775963 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.775995 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.778426 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.779077 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.779081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.779083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.779219 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.779589 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.779592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.779594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.779988 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.780175 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.780402 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.780554 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 03:12:51.781322 24312 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37030
I20260810 03:12:51.782229 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24406
I20260810 03:12:51.793179 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.783049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.18.112.65:42095)
0810 03:12:51.783196 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.783200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.783426 (+ 226us) server_negotiation.cc:407] Connection header received
0810 03:12:51.783536 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.783539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.783594 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.783667 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.784758 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.785419 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.786562 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.786970 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.787059 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.789056 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.789060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.789063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.789087 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.791285 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.791822 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.791827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.791830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.791950 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.792228 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.792230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.792232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.792449 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.792617 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.792803 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.792952 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:12:51.793700 24587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:51.874078 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 24406
I20260810 03:12:51.895794 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24600
Aug 10 03:12:51 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:51.910040 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:51.896676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57390 (local address 127.18.112.66:40441)
0810 03:12:51.897170 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:51.897178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:51.897205 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:12:51.897276 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:51.897282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:51.897490 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:51.897626 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:51.898683 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.899653 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.900900 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:51.901438 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:51.901531 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:51.905315 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:51.905326 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:51.905339 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:51.905371 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:51.907855 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.908424 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.908430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.908433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.908555 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:51.908830 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:51.908832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:51.908835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:51.909157 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:51.909374 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:51.909561 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 03:12:51.909746 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":232,"threads_started":1}
I20260810 03:12:51.911208 24791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:51.990557 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 24600
I20260810 03:12:52.011430 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24811
Aug 10 03:12:52 dist-test-slave-jlzn krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:52.026947 25015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:52.012480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42568 (local address 127.18.112.67:39449)
0810 03:12:52.013112 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:52.013118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:52.013150 (+ 32us) server_negotiation.cc:407] Connection header received
0810 03:12:52.013215 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:52.013221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:52.013426 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:52.013554 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:52.014741 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:52.015761 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:52.017107 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:52.017673 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:52.017765 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:52.021729 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:52.021741 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:52.021756 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:52.021788 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:52.024594 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:52.025197 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:52.025204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:52.025206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:52.025338 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:52.025635 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:52.025638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:52.025640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:52.025956 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:52.026194 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:52.026376 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 03:12:52.026578 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":325,"threads_started":1}
I20260810 03:12:52.028282 24988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:52.108386 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 24811
I20260810 03:12:52.128451 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 24264
I20260810 03:12:52.129644 24361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:52.229511 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 24264
2026-08-10T03:12:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3818 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:12:52 dist-test-slave-jlzn krb5kdc[25023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:12:52 dist-test-slave-jlzn krb5kdc[25023](info): set up 2 sockets
Aug 10 03:12:52 dist-test-slave-jlzn krb5kdc[25023](info): commencing operation
krb5kdc: starting...
W20260810 03:12:53.399158 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.002s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:12:53 dist-test-slave-jlzn krb5kdc[25023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:12:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:12:53.585296 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46805
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:46805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:53.896626 25042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:53.896910 25042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:53.897049 25042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:53.903970 25042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:53.904073 25042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:53.904148 25042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:53.904219 25042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:53.904281 25042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:53.913612 25042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:46805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:46805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:53.914803 25042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:53.916054 25042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:53.926807 25058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:53.926867 25053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:53.926843 25050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:53.927656 25042 server_base.cc:1034] running on GCE node
I20260810 03:12:53.928407 25042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:53.929631 25042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:53.930843 25042 hybrid_clock.cc:648] HybridClock initialized: now 1786331573930795 us; error 39 us; skew 500 ppm
I20260810 03:12:53.931169 25042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:53 dist-test-slave-jlzn krb5kdc[25023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:53.934151 25042 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:12:53.935248 25042 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:53.935350 25042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:53.935648 25042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:53.938495 25042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "9971c37f5ad04a3ba8df8660e5ba56c2"
format_stamp: "Formatted at 2026-08-10 03:12:53 on dist-test-slave-jlzn"
server_key: "87902d5dd99c2ddc20014d4e6e065347"
server_key_iv: "7561fe09ba3c7c69f2e5f428dbff6687"
server_key_version: "encryptionkey@0"
I20260810 03:12:53.939250 25042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "9971c37f5ad04a3ba8df8660e5ba56c2"
format_stamp: "Formatted at 2026-08-10 03:12:53 on dist-test-slave-jlzn"
server_key: "87902d5dd99c2ddc20014d4e6e065347"
server_key_iv: "7561fe09ba3c7c69f2e5f428dbff6687"
server_key_version: "encryptionkey@0"
I20260810 03:12:53.943943 25042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260810 03:12:53.947113 25068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:53.948302 25042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:53.948464 25042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "9971c37f5ad04a3ba8df8660e5ba56c2"
format_stamp: "Formatted at 2026-08-10 03:12:53 on dist-test-slave-jlzn"
server_key: "87902d5dd99c2ddc20014d4e6e065347"
server_key_iv: "7561fe09ba3c7c69f2e5f428dbff6687"
server_key_version: "encryptionkey@0"
I20260810 03:12:53.948652 25042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:53.961732 25042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:53.965616 25042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:53.965855 25042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:53.982724 25042 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:46805
I20260810 03:12:53.982743 25135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:46805 every 8 connection(s)
I20260810 03:12:53.983516 25042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:53.986863 25136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:53.989765 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25042
I20260810 03:12:53.989967 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:53.990799 18881 external_mini_cluster.cc:1428] Setting key adba0777f3b607f60a2b6764442c796d
I20260810 03:12:53.999011 25136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: Bootstrap starting.
I20260810 03:12:54.002568 25136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:54.003829 25136 log.cc:824] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:12:54 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:54.006784 25136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: No bootstrap required, opened a new log
I20260810 03:12:54.014205 25139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:53.992876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60608 (local address 127.18.112.126:46805)
0810 03:12:53.993598 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:53.993609 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:53.993650 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:12:53.995232 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:53.995253 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:53.995610 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:53.995958 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:53.997672 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:53.998905 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.000607 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:54.001272 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.001391 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:54.006214 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:54.006221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:54.006235 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:54.006269 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:54.009934 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:54.010586 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:54.010595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:54.010602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:54.010804 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:54.011127 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:54.011132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:54.011143 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:54.011875 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:54.012187 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:54.012465 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:12:54.012870 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":338,"threads_started":1}
I20260810 03:12:54.016870 25136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } }
I20260810 03:12:54.017243 25136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:54.017328 25136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9971c37f5ad04a3ba8df8660e5ba56c2, State: Initialized, Role: FOLLOWER
I20260810 03:12:54.017823 25136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } }
I20260810 03:12:54.018020 25136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:54.018110 25136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:54.018232 25136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:54.020258 25136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } }
I20260810 03:12:54.020665 25136 leader_election.cc:302] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9971c37f5ad04a3ba8df8660e5ba56c2; no voters:
I20260810 03:12:54.021152 25136 leader_election.cc:288] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:54.021311 25143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:54.021971 25143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [term 1 LEADER]: Becoming Leader. State: Replica: 9971c37f5ad04a3ba8df8660e5ba56c2, State: Running, Role: LEADER
I20260810 03:12:54.022490 25143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } }
I20260810 03:12:54.023037 25136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:54.025434 25145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9971c37f5ad04a3ba8df8660e5ba56c2. Latest consensus state: current_term: 1 leader_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } } }
I20260810 03:12:54.025506 25144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9971c37f5ad04a3ba8df8660e5ba56c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 46805 } } }
I20260810 03:12:54.025776 25145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:54.028618 25144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:54.028812 25151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:54.033433 25151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:54.041399 25151 catalog_manager.cc:1347] Generated new cluster ID: ae430f370b134f8a8c009e29ff616703
I20260810 03:12:54.041500 25151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:54.055845 25151 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:54.057596 25151 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:54.068647 25151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: Generated new TSK 0
I20260810 03:12:54.069473 25151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:12:54.133136 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:54.445195 25178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:54.445454 25178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:54.445595 25178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:54.452812 25178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:54.452925 25178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:54.453069 25178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:54.462400 25178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:54.463560 25178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:54.464848 25178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:54.476670 25185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:54.476735 25186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:54.476711 25189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:54.477699 25178 server_base.cc:1034] running on GCE node
I20260810 03:12:54.478255 25178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:54.479120 25178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:54.480315 25178 hybrid_clock.cc:648] HybridClock initialized: now 1786331574480276 us; error 29 us; skew 500 ppm
I20260810 03:12:54.480600 25178 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:54 dist-test-slave-jlzn krb5kdc[25023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331574, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:54.483508 25178 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:12:54.484628 25178 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:54.484732 25178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:54.485024 25178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:54.487797 25178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "c6ea51c46b9042e8880dcb9742fc3b8d"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "191e1ebf46b02587fda6cc9f64022e92"
server_key_iv: "35d525cc2f56d34d60046c22a8bc5396"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.488619 25178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "c6ea51c46b9042e8880dcb9742fc3b8d"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "191e1ebf46b02587fda6cc9f64022e92"
server_key_iv: "35d525cc2f56d34d60046c22a8bc5396"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.493420 25178 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:54.496642 25199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:54.497797 25178 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:54.497949 25178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "c6ea51c46b9042e8880dcb9742fc3b8d"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "191e1ebf46b02587fda6cc9f64022e92"
server_key_iv: "35d525cc2f56d34d60046c22a8bc5396"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.498142 25178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:54.514379 25178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:54.518157 25178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:54.518407 25178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:54.519299 25178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:54.520655 25178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:54.520751 25178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:54.520856 25178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:54.520929 25178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:54.550201 25178 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:37017
I20260810 03:12:54.550248 25368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:37017 every 8 connection(s)
I20260810 03:12:54.551030 25178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:54.561105 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25178
I20260810 03:12:54.561327 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:54.561985 18881 external_mini_cluster.cc:1428] Setting key 333434956c9a0fadd78ce6b54e2804b8
Aug 10 03:12:54 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331574, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:54.570802 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:54.553408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:37013 (local address 127.18.112.126:46805)
0810 03:12:54.553841 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:54.553846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:54.554711 (+ 865us) server_negotiation.cc:407] Connection header received
0810 03:12:54.556595 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:54.556600 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:54.556687 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:54.556782 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:54.558256 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:54.558995 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.560564 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:54.561125 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.561261 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:54.564753 (+ 3492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:54.564759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:54.564763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:54.564805 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:54.567610 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:54.568592 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:54.568597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:54.568600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:54.568777 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:54.569153 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:54.569157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:54.569160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:54.569483 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:54.569617 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:54.570205 (+ 588us) server_negotiation.cc:299] Negotiation successful
0810 03:12:54.570416 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":235,"threads_started":1}
I20260810 03:12:54.571537 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:54.553836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46805 (local address 127.18.112.65:37013)
0810 03:12:54.554528 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:54.554590 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:54.556335 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:54.557030 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:54.557038 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:54.557546 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:54.558077 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:54.558094 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:54.559150 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.559154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:54.560425 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:54.560438 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:54.561361 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:54.561369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:54.561583 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:54.562229 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:54.562257 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:54.564541 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:54.567939 (+ 3398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:54.567945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:54.567956 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:54.568466 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:54.568878 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:54.568881 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:54.568883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:54.569050 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:54.569588 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:54.569593 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:54.569871 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 03:12:54.570076 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 03:12:54.570440 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":280,"threads_started":1}
I20260810 03:12:54.572921 25370 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46805
I20260810 03:12:54.573217 25370 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:54.573926 25370 heartbeater.cc:511] Master 127.18.112.126:46805 requested a full tablet report, sending...
I20260810 03:12:54.576236 25093 ts_manager.cc:194] Registered new tserver with Master: c6ea51c46b9042e8880dcb9742fc3b8d (127.18.112.65:37017)
I20260810 03:12:54.578253 25093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:37013
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:12:54.608309 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:54.919358 25383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:54.919641 25383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:54.919741 25383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:54.926810 25383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:54.926904 25383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:54.927021 25383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:54.936410 25383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:54.937561 25383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:54.938752 25383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:54.950726 25390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:54.950778 25391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:54.950696 25393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:54.951776 25383 server_base.cc:1034] running on GCE node
I20260810 03:12:54.952358 25383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:54.953224 25383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:54.954439 25383 hybrid_clock.cc:648] HybridClock initialized: now 1786331574954387 us; error 37 us; skew 500 ppm
I20260810 03:12:54.954732 25383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:54 dist-test-slave-jlzn krb5kdc[25023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331574, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:54.957836 25383 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:12:54.958870 25383 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:54.958962 25383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:54.959249 25383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:54.961978 25383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "d22095b9f02147ca83d5da1a400334cd"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "88c8a2f6f2638e6d97cee47d6ab75f43"
server_key_iv: "90c6009dbaa289119eaee0c38f83d3bd"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.962764 25383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "d22095b9f02147ca83d5da1a400334cd"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "88c8a2f6f2638e6d97cee47d6ab75f43"
server_key_iv: "90c6009dbaa289119eaee0c38f83d3bd"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.967279 25383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260810 03:12:54.970547 25413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:54.971701 25383 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:12:54.971875 25383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "d22095b9f02147ca83d5da1a400334cd"
format_stamp: "Formatted at 2026-08-10 03:12:54 on dist-test-slave-jlzn"
server_key: "88c8a2f6f2638e6d97cee47d6ab75f43"
server_key_iv: "90c6009dbaa289119eaee0c38f83d3bd"
server_key_version: "encryptionkey@0"
I20260810 03:12:54.972070 25383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:54.984210 25383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:54.987982 25383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:54.988224 25383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:54.989135 25383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:54.990370 25383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:54.990455 25383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:54.990562 25383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:54.990626 25383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:55.020538 25383 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:41959
I20260810 03:12:55.020594 25572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:41959 every 8 connection(s)
I20260810 03:12:55.021322 25383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:55.023358 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25383
I20260810 03:12:55.023515 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:55.024094 18881 external_mini_cluster.cc:1428] Setting key a2e288dcd849a447bde4ce57409d7569
Aug 10 03:12:55 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331574, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:55.041742 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.023611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:59849 (local address 127.18.112.126:46805)
0810 03:12:55.023836 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.023843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.025096 (+ 1253us) server_negotiation.cc:407] Connection header received
0810 03:12:55.027352 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.027356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.027421 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.027491 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:55.029348 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.030053 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.032084 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.032627 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.032735 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.036470 (+ 3735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:55.036475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:55.036478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:55.036509 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:55.038887 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.039548 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.039552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.039555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.039698 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.040131 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.040134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.040137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.040441 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:55.040574 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.041187 (+ 613us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.041410 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:12:55.042594 25582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.024146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46805 (local address 127.18.112.66:59849)
0810 03:12:55.024929 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.024979 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.027072 (+ 2093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.027748 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.027760 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.028490 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:55.029200 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.029223 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.030206 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.030211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.031965 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.031980 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.032835 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.032841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.033101 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.033753 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:55.033779 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:55.036271 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:55.039010 (+ 2739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:55.039019 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:55.039033 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:55.039430 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:55.039822 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:55.039828 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:55.039832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:55.040019 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:55.040561 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:55.040568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:55.040859 (+ 291us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.041077 (+ 218us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.041547 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":334,"threads_started":1}
I20260810 03:12:55.043939 25573 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46805
I20260810 03:12:55.044219 25573 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:55.044821 25573 heartbeater.cc:511] Master 127.18.112.126:46805 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
I20260810 03:12:55.046241 25093 ts_manager.cc:194] Registered new tserver with Master: d22095b9f02147ca83d5da1a400334cd (127.18.112.66:41959)
I20260810 03:12:55.047096 25093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:59849
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:12:55.070397 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:12:55.381533 25585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:55.381779 25585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:55.381886 25585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:55.388666 25585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:55.388756 25585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:55.388870 25585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:55.397861 25585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:46805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:55.398963 25585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:55.400157 25585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:55.411993 25595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:55.412046 25596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:55.412071 25601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:55.412742 25585 server_base.cc:1034] running on GCE node
I20260810 03:12:55.413313 25585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:55.414160 25585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:55.415352 25585 hybrid_clock.cc:648] HybridClock initialized: now 1786331575415297 us; error 50 us; skew 500 ppm
I20260810 03:12:55.415640 25585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:12:55 dist-test-slave-jlzn krb5kdc[25023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331575, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:12:55.421881 25585 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:12:55.422989 25585 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:55.423097 25585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:55.423390 25585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:55.426194 25585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "20a74505b5e44613a22240cce2518826"
format_stamp: "Formatted at 2026-08-10 03:12:55 on dist-test-slave-jlzn"
server_key: "a051b012e9cb6b4d56d3ab89db67497a"
server_key_iv: "3cdf8dba6839166827d76290838a9648"
server_key_version: "encryptionkey@0"
I20260810 03:12:55.426939 25585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "20a74505b5e44613a22240cce2518826"
format_stamp: "Formatted at 2026-08-10 03:12:55 on dist-test-slave-jlzn"
server_key: "a051b012e9cb6b4d56d3ab89db67497a"
server_key_iv: "3cdf8dba6839166827d76290838a9648"
server_key_version: "encryptionkey@0"
I20260810 03:12:55.431576 25585 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:12:55.434856 25613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:55.436152 25585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:12:55.436314 25585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "20a74505b5e44613a22240cce2518826"
format_stamp: "Formatted at 2026-08-10 03:12:55 on dist-test-slave-jlzn"
server_key: "a051b012e9cb6b4d56d3ab89db67497a"
server_key_iv: "3cdf8dba6839166827d76290838a9648"
server_key_version: "encryptionkey@0"
I20260810 03:12:55.436504 25585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:55.463778 25585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:55.467406 25585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:55.467669 25585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:55.468597 25585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:55.469843 25585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:55.469964 25585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:55.470070 25585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:55.470146 25585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:55.499727 25585 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:46853
I20260810 03:12:55.499764 25766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:46853 every 8 connection(s)
I20260810 03:12:55.500510 25585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:55.505918 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25585
I20260810 03:12:55.506102 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:55.506669 18881 external_mini_cluster.cc:1428] Setting key 8a7b9a38c3e141677cf981a3f14d6350
Aug 10 03:12:55 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331575, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:12:55.518967 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.502890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:59847 (local address 127.18.112.126:46805)
0810 03:12:55.503058 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.503063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.504185 (+ 1122us) server_negotiation.cc:407] Connection header received
0810 03:12:55.506084 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.506090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.506211 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.506302 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:55.508118 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.508964 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.510624 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.511006 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.511101 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.514220 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:55.514225 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:55.514228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:55.514259 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:55.516609 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.517226 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.517229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.517232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.517351 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.517684 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.517687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.517690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.517948 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:55.518067 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.518586 (+ 519us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.518735 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:12:55.519892 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.503307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:46805 (local address 127.18.112.67:59847)
0810 03:12:55.504035 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.504072 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.505768 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.506585 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.506596 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.507309 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:55.507966 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.507986 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.509110 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.509116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.510490 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.510503 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.511178 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.511183 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.511361 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.511992 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:12:55.512019 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:55.514033 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:55.516722 (+ 2689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:55.516728 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:55.516739 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:55.517126 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:55.517424 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:12:55.517427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:12:55.517429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:12:55.517598 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:12:55.518037 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:55.518042 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:55.518315 (+ 273us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.518527 (+ 212us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.518878 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":294,"threads_started":1}
I20260810 03:12:55.521314 25767 heartbeater.cc:347] Connected to a master server at 127.18.112.126:46805
I20260810 03:12:55.521621 25767 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:55.522238 25767 heartbeater.cc:511] Master 127.18.112.126:46805 requested a full tablet report, sending...
I20260810 03:12:55.523599 25092 ts_manager.cc:194] Registered new tserver with Master: 20a74505b5e44613a22240cce2518826 (127.18.112.67:46853)
I20260810 03:12:55.524597 25092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:59847
I20260810 03:12:55.533584 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:12:55.549415 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.537789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60616 (local address 127.18.112.126:46805)
0810 03:12:55.537922 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.537926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.538401 (+ 475us) server_negotiation.cc:407] Connection header received
0810 03:12:55.538549 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.538555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.538629 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.538706 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:55.540128 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.540885 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.542099 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.542519 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.542632 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.544787 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:55.544792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:55.544795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:55.544824 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:55.546985 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.547547 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.547553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.547556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.547682 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.548062 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.548067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.548071 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.548394 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:55.548617 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.548950 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.549155 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:12:55.553375 25092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:55.560843 25092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:55.581688 25370 heartbeater.cc:503] Master 127.18.112.126:46805 was elected leader, sending a full tablet report...
I20260810 03:12:55.595376 25789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.571236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:46853 (local address 127.0.0.1:48712)
0810 03:12:55.572279 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.572311 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.572468 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.588103 (+ 15635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.588112 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.588149 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:55.588652 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.588666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.590631 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.590636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.593021 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.593041 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.594351 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.594358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.594575 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.594633 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.594734 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.594904 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":1,"thread_start_us":678,"threads_started":1}
I20260810 03:12:55.596005 25792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.572273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48712 (local address 127.18.112.67:46853)
0810 03:12:55.587511 (+ 15238us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.587519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.587546 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:12:55.587630 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.587636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.587833 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.588044 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:55.589138 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.590510 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.593194 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.594145 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.595256 (+ 1111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.595476 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.595556 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.595716 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15090,"thread_start_us":14933,"threads_started":1}
I20260810 03:12:55.596073 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.572609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:41959 (local address 127.0.0.1:37636)
0810 03:12:55.588761 (+ 16152us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.588777 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.588914 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.589535 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.589540 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.589566 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:55.589912 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.589923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.591475 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.591480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.593141 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.593161 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.595219 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.595226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.595404 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.595433 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.595524 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.595626 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16030,"mutex_wait_us":54,"thread_start_us":13879,"threads_started":1}
I20260810 03:12:55.596097 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.571688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:37017 (local address 127.0.0.1:38746)
0810 03:12:55.586277 (+ 14589us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.586298 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.586422 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.588728 (+ 2306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.588733 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.588761 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:55.589210 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.589223 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.590928 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.590933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.593179 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.593191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.594980 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.594986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.595165 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.595205 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.595272 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.595396 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14437,"mutex_wait_us":65,"thread_start_us":16750,"threads_started":1}
I20260810 03:12:55.596809 25795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.572996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37636 (local address 127.18.112.66:41959)
0810 03:12:55.587037 (+ 14041us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.587046 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.588870 (+ 1824us) server_negotiation.cc:407] Connection header received
0810 03:12:55.589097 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.589105 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.589327 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.589522 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:55.590092 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.591336 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.593310 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.594735 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.594870 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.595073 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.596319 (+ 1246us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.596484 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13879,"thread_start_us":13759,"threads_started":1}
I20260810 03:12:55.597221 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.571787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38746 (local address 127.18.112.65:37017)
0810 03:12:55.587424 (+ 15637us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.587432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.587460 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:12:55.587562 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.587570 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.587836 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.588119 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:55.589409 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.590794 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.593337 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.594735 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.596466 (+ 1731us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.596679 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.596745 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.596896 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15464,"thread_start_us":15277,"threads_started":1}
I20260810 03:12:55.599949 25278 tablet_service.cc:1467] Processing CreateTablet for tablet 885b7cc42c05483db39a08e604ad032b (DEFAULT_TABLE table=test-table [id=550f490730fc4900ad6759cce929b7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:55.599761 25681 tablet_service.cc:1467] Processing CreateTablet for tablet 885b7cc42c05483db39a08e604ad032b (DEFAULT_TABLE table=test-table [id=550f490730fc4900ad6759cce929b7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:55.600204 25483 tablet_service.cc:1467] Processing CreateTablet for tablet 885b7cc42c05483db39a08e604ad032b (DEFAULT_TABLE table=test-table [id=550f490730fc4900ad6759cce929b7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:55.601132 25278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885b7cc42c05483db39a08e604ad032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:55.601193 25681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885b7cc42c05483db39a08e604ad032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:55.601608 25483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 885b7cc42c05483db39a08e604ad032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:55.612301 25796 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Bootstrap starting.
I20260810 03:12:55.615087 25800 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Bootstrap starting.
I20260810 03:12:55.615708 25796 tablet_bootstrap.cc:654] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:55.617072 25796 log.cc:824] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:55.618479 25797 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Bootstrap starting.
I20260810 03:12:55.618477 25800 tablet_bootstrap.cc:654] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:55.619684 25800 log.cc:824] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:55.620543 25796 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: No bootstrap required, opened a new log
I20260810 03:12:55.620810 25796 ts_tablet_manager.cc:1397] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260810 03:12:55.621850 25797 tablet_bootstrap.cc:654] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:55.623006 25797 log.cc:824] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:55.623972 25800 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: No bootstrap required, opened a new log
I20260810 03:12:55.624223 25800 ts_tablet_manager.cc:1397] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260810 03:12:55.626085 25797 tablet_bootstrap.cc:492] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: No bootstrap required, opened a new log
I20260810 03:12:55.626331 25797 ts_tablet_manager.cc:1397] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260810 03:12:55.628387 25796 raft_consensus.cc:348] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.628718 25796 raft_consensus.cc:374] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:55.628814 25796 raft_consensus.cc:729] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ea51c46b9042e8880dcb9742fc3b8d, State: Initialized, Role: FOLLOWER
I20260810 03:12:55.629380 25796 consensus_queue.cc:260] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.631040 25796 ts_tablet_manager.cc:1428] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260810 03:12:55.632638 25805 raft_consensus.cc:482] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:55.634373 25800 raft_consensus.cc:348] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.634799 25800 raft_consensus.cc:374] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:55.634892 25800 raft_consensus.cc:729] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a74505b5e44613a22240cce2518826, State: Initialized, Role: FOLLOWER
I20260810 03:12:55.632861 25805 raft_consensus.cc:504] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.635619 25800 consensus_queue.cc:260] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.636394 25797 raft_consensus.cc:348] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.636824 25797 raft_consensus.cc:374] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:55.636920 25797 raft_consensus.cc:729] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22095b9f02147ca83d5da1a400334cd, State: Initialized, Role: FOLLOWER
I20260810 03:12:55.637513 25797 consensus_queue.cc:260] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.637725 25805 leader_election.cc:288] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20a74505b5e44613a22240cce2518826 (127.18.112.67:46853), d22095b9f02147ca83d5da1a400334cd (127.18.112.66:41959)
I20260810 03:12:55.641582 25573 heartbeater.cc:503] Master 127.18.112.126:46805 was elected leader, sending a full tablet report...
I20260810 03:12:55.642549 25797 ts_tablet_manager.cc:1428] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260810 03:12:55.646528 25792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.637978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:50909 (local address 127.18.112.67:46853)
0810 03:12:55.638170 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.638176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.638796 (+ 620us) server_negotiation.cc:407] Connection header received
0810 03:12:55.639068 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.639073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.639148 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.639211 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:55.640070 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.641287 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.643901 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.645271 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.645403 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.645482 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.646102 (+ 620us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.646248 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:12:55.647269 25810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.638028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:46853 (local address 127.18.112.65:50909)
0810 03:12:55.638706 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.638726 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.638901 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.639406 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.639410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.639437 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:55.639900 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.639914 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.641542 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.641547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.643684 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.643702 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.645699 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.645706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.645913 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.645948 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.646752 (+ 804us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.646903 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":356,"threads_started":1}
I20260810 03:12:55.647269 25767 heartbeater.cc:503] Master 127.18.112.126:46805 was elected leader, sending a full tablet report...
I20260810 03:12:55.647969 25800 ts_tablet_manager.cc:1428] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Time spent starting tablet: real 0.024s user 0.016s sys 0.008s
I20260810 03:12:55.649473 25709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "885b7cc42c05483db39a08e604ad032b" candidate_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a74505b5e44613a22240cce2518826" is_pre_election: true
I20260810 03:12:55.649968 25709 raft_consensus.cc:2454] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ea51c46b9042e8880dcb9742fc3b8d in term 0.
I20260810 03:12:55.650693 25205 leader_election.cc:302] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a74505b5e44613a22240cce2518826, c6ea51c46b9042e8880dcb9742fc3b8d; no voters:
I20260810 03:12:55.651074 25805 raft_consensus.cc:2781] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:55.651221 25805 raft_consensus.cc:482] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:55.651326 25805 raft_consensus.cc:3037] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:55.653734 25805 raft_consensus.cc:504] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.654167 25795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.639292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:50465 (local address 127.18.112.66:41959)
0810 03:12:55.639483 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.639489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.647568 (+ 8079us) server_negotiation.cc:407] Connection header received
0810 03:12:55.647832 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.647838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.647908 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.647966 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:12:55.648500 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.649384 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.652505 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.653322 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.653455 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.653536 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.653814 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.653935 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:12:55.654232 25810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.638802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:41959 (local address 127.18.112.65:50465)
0810 03:12:55.647465 (+ 8663us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:55.647483 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:55.647667 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:55.648151 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:55.648156 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:55.648182 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:12:55.648343 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.648353 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.649733 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.649738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.652320 (+ 2582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:55.652353 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.653470 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.653476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:55.653668 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.653694 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:12:55.653777 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 03:12:55.653906 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8580,"thread_start_us":9656,"threads_started":1}
I20260810 03:12:55.654318 25805 leader_election.cc:288] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [CANDIDATE]: Term 1 election: Requested vote from peers 20a74505b5e44613a22240cce2518826 (127.18.112.67:46853), d22095b9f02147ca83d5da1a400334cd (127.18.112.66:41959)
I20260810 03:12:55.654999 25709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "885b7cc42c05483db39a08e604ad032b" candidate_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a74505b5e44613a22240cce2518826"
I20260810 03:12:55.655223 25709 raft_consensus.cc:3037] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:55.655462 25508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "885b7cc42c05483db39a08e604ad032b" candidate_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22095b9f02147ca83d5da1a400334cd"
I20260810 03:12:55.655547 25509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "885b7cc42c05483db39a08e604ad032b" candidate_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22095b9f02147ca83d5da1a400334cd" is_pre_election: true
I20260810 03:12:55.655908 25508 raft_consensus.cc:3037] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:55.658004 25709 raft_consensus.cc:2454] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ea51c46b9042e8880dcb9742fc3b8d in term 1.
I20260810 03:12:55.658340 25205 leader_election.cc:302] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a74505b5e44613a22240cce2518826, c6ea51c46b9042e8880dcb9742fc3b8d; no voters:
I20260810 03:12:55.658365 25508 raft_consensus.cc:2454] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ea51c46b9042e8880dcb9742fc3b8d in term 1.
I20260810 03:12:55.658574 25805 raft_consensus.cc:2781] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:55.658967 25805 raft_consensus.cc:686] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 1 LEADER]: Becoming Leader. State: Replica: c6ea51c46b9042e8880dcb9742fc3b8d, State: Running, Role: LEADER
I20260810 03:12:55.659415 25805 consensus_queue.cc:237] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } }
I20260810 03:12:55.663367 25092 catalog_manager.cc:5495] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ea51c46b9042e8880dcb9742fc3b8d (127.18.112.65). New cstate: current_term: 1 leader_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6ea51c46b9042e8880dcb9742fc3b8d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 37017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 } health_report { overall_health: UNKNOWN } } }
I20260810 03:12:55.680625 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.675670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38758 (local address 127.18.112.65:37017)
0810 03:12:55.675869 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.675873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.675891 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:12:55.676119 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.676124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.676204 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.676320 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:12:55.676672 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.677370 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.678651 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.679034 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.679140 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.679591 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:12:55.680079 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:12:55.680209 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.680310 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.680388 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:12:55.687722 25508 raft_consensus.cc:1261] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 1 FOLLOWER]: Refusing update from remote peer c6ea51c46b9042e8880dcb9742fc3b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:55.687872 25709 raft_consensus.cc:1261] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 1 FOLLOWER]: Refusing update from remote peer c6ea51c46b9042e8880dcb9742fc3b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:55.688570 25813 consensus_queue.cc:1035] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22095b9f02147ca83d5da1a400334cd" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:55.688964 25805 consensus_queue.cc:1035] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a74505b5e44613a22240cce2518826" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:55.702405 25823 mvcc.cc:205] Tried to move back new op lower bound from 7316814134008373248 to 7316814133904388096. Current Snapshot: MvccSnapshot[applied={T|T < 7316814134008373248}]
I20260810 03:12:55.711263 25092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:55.711563 25092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:55.715202 25092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9971c37f5ad04a3ba8df8660e5ba56c2: Sending DeleteTablet for 3 replicas of tablet 885b7cc42c05483db39a08e604ad032b
I20260810 03:12:55.716337 25278 tablet_service.cc:1514] Processing DeleteTablet for tablet 885b7cc42c05483db39a08e604ad032b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:55 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38746
I20260810 03:12:55.716629 25681 tablet_service.cc:1514] Processing DeleteTablet for tablet 885b7cc42c05483db39a08e604ad032b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:55 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:48712
I20260810 03:12:55.717278 25483 tablet_service.cc:1514] Processing DeleteTablet for tablet 885b7cc42c05483db39a08e604ad032b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:55 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:37636
I20260810 03:12:55.717509 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25178
I20260810 03:12:55.728770 25831 tablet_replica.cc:330] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: stopping tablet replica
I20260810 03:12:55.729319 25832 tablet_replica.cc:330] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: stopping tablet replica
I20260810 03:12:55.729892 25832 raft_consensus.cc:2229] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:55.730400 25831 raft_consensus.cc:2229] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:55.731093 25831 raft_consensus.cc:2258] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:55.731665 25832 raft_consensus.cc:2258] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:55.732946 25837 tablet_replica.cc:330] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: stopping tablet replica
I20260810 03:12:55.733311 25837 raft_consensus.cc:2229] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:55.733776 25837 raft_consensus.cc:2258] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:55.734462 25831 ts_tablet_manager.cc:1905] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:55.734508 25832 ts_tablet_manager.cc:1905] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:55.735702 25837 ts_tablet_manager.cc:1905] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:55.741588 25832 ts_tablet_manager.cc:1918] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:55.741827 25832 log.cc:1196] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/885b7cc42c05483db39a08e604ad032b
I20260810 03:12:55.741839 25831 ts_tablet_manager.cc:1918] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:55.742013 25831 log.cc:1196] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/885b7cc42c05483db39a08e604ad032b
I20260810 03:12:55.742594 25831 ts_tablet_manager.cc:1939] T 885b7cc42c05483db39a08e604ad032b P c6ea51c46b9042e8880dcb9742fc3b8d: Deleting consensus metadata
I20260810 03:12:55.743053 25832 ts_tablet_manager.cc:1939] T 885b7cc42c05483db39a08e604ad032b P 20a74505b5e44613a22240cce2518826: Deleting consensus metadata
I20260810 03:12:55.744308 25072 catalog_manager.cc:4841] TS c6ea51c46b9042e8880dcb9742fc3b8d (127.18.112.65:37017): tablet 885b7cc42c05483db39a08e604ad032b (table test-table [id=550f490730fc4900ad6759cce929b7df]) successfully deleted
I20260810 03:12:55.745208 25073 catalog_manager.cc:4841] TS 20a74505b5e44613a22240cce2518826 (127.18.112.67:46853): tablet 885b7cc42c05483db39a08e604ad032b (table test-table [id=550f490730fc4900ad6759cce929b7df]) successfully deleted
Aug 10 03:12:55 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:12:55.747251 25837 ts_tablet_manager.cc:1918] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:55.747416 25837 log.cc:1196] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/885b7cc42c05483db39a08e604ad032b
I20260810 03:12:55.747942 25837 ts_tablet_manager.cc:1939] T 885b7cc42c05483db39a08e604ad032b P d22095b9f02147ca83d5da1a400334cd: Deleting consensus metadata
I20260810 03:12:55.749451 25073 catalog_manager.cc:4841] TS d22095b9f02147ca83d5da1a400334cd (127.18.112.66:41959): tablet 885b7cc42c05483db39a08e604ad032b (table test-table [id=550f490730fc4900ad6759cce929b7df]) successfully deleted
I20260810 03:12:55.753237 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.719020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38772 (local address 127.18.112.65:37017)
0810 03:12:55.719195 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.719201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.729143 (+ 9942us) server_negotiation.cc:407] Connection header received
0810 03:12:55.729593 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.729598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.729670 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.729740 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:55.731521 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.733351 (+ 1830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.740771 (+ 7420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.741472 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.741577 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.746687 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:55.746701 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:55.746718 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:55.746765 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:55.750280 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.751065 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.751071 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.751074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.751221 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.751654 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.751659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.751662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.752051 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:55.752268 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.752629 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.752876 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:12:55.753949 25361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:55.849251 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25178
I20260810 03:12:55.872977 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25383
Aug 10 03:12:55 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:12:55.886785 25795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:55.873763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.18.112.66:41959)
0810 03:12:55.873952 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:55.873957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:55.873977 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:12:55.874058 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:55.874062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:55.874123 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:55.874213 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:55.875435 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.876293 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.877524 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:55.877885 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:55.877968 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:55.881874 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:55.881888 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:55.881903 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:55.881947 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:55.884567 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.885140 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.885146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.885148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.885269 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:55.885540 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:55.885543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:55.885545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:55.885906 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:55.886118 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:55.886310 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 03:12:55.886471 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:12:55.887454 25566 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:55.973378 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25383
I20260810 03:12:56.001696 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25585
Aug 10 03:12:56 dist-test-slave-jlzn krb5kdc[25023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:12:56.016580 25792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:56.002492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48728 (local address 127.18.112.67:46853)
0810 03:12:56.002685 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:56.002691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:56.002711 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:12:56.002893 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:56.002898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:56.002973 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:56.003059 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:56.004423 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:56.005156 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:56.006389 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:56.006787 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:56.006895 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:56.011123 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:56.011140 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:56.011157 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:12:56.011190 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:56.013936 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:56.014578 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:56.014586 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:56.014588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:56.014719 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:12:56.015069 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:12:56.015073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:12:56.015075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:12:56.015422 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:56.015697 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:56.016080 (+ 383us) server_negotiation.cc:299] Negotiation successful
0810 03:12:56.016319 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:12:56.017241 25762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:56.104199 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25585
I20260810 03:12:56.125667 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25042
I20260810 03:12:56.126806 25130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:56.237056 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25042
2026-08-10T03:12:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4010 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T03:12:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:56Z Disabled control of system clock
I20260810 03:12:56.309624 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:42593
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:42593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 03:12:56.619531 25847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:56.619791 25847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:56.619935 25847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:56.626788 25847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:56.626885 25847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:56.626948 25847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:56.627020 25847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:56.627079 25847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:12:56.635767 25847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:42593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:42593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:56.636927 25847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:56.638582 25847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:56.649603 25852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:56.649633 25855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:56.649683 25853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:56.650527 25847 server_base.cc:1034] running on GCE node
I20260810 03:12:56.651244 25847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:56.652527 25847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:56.653733 25847 hybrid_clock.cc:648] HybridClock initialized: now 1786331576653683 us; error 30 us; skew 500 ppm
I20260810 03:12:56.654038 25847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:56.656211 25847 webserver.cc:460] Webserver started at http://127.18.112.126:40709/ using document root <none> and password file <none>
I20260810 03:12:56.656821 25847 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:56.656905 25847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:56.657160 25847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:56.659963 25847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "79d1c77bb59841448190c3d2af023389"
format_stamp: "Formatted at 2026-08-10 03:12:56 on dist-test-slave-jlzn"
server_key: "0b7384111c5651f88284671ebaab52af"
server_key_iv: "0281695b1427910466b0f1a0f2b5b511"
server_key_version: "encryptionkey@0"
I20260810 03:12:56.660708 25847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "79d1c77bb59841448190c3d2af023389"
format_stamp: "Formatted at 2026-08-10 03:12:56 on dist-test-slave-jlzn"
server_key: "0b7384111c5651f88284671ebaab52af"
server_key_iv: "0281695b1427910466b0f1a0f2b5b511"
server_key_version: "encryptionkey@0"
I20260810 03:12:56.665406 25847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:56.668502 25863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:56.669694 25847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:56.669850 25847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "79d1c77bb59841448190c3d2af023389"
format_stamp: "Formatted at 2026-08-10 03:12:56 on dist-test-slave-jlzn"
server_key: "0b7384111c5651f88284671ebaab52af"
server_key_iv: "0281695b1427910466b0f1a0f2b5b511"
server_key_version: "encryptionkey@0"
I20260810 03:12:56.670050 25847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:56.675315 25847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:56.676036 25847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:56.676306 25847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:56.692217 25847 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:42593
I20260810 03:12:56.692269 25937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:42593 every 8 connection(s)
I20260810 03:12:56.693372 25847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:56.694653 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25847
I20260810 03:12:56.694875 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:56.695722 18881 external_mini_cluster.cc:1428] Setting key 2159ae3b367c7bd2a8ae4d3490817885
I20260810 03:12:56.697721 25938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:56.704463 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:56.697742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.18.112.126:42593)
0810 03:12:56.698773 (+ 1031us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:56.698786 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:56.698834 (+ 48us) server_negotiation.cc:407] Connection header received
0810 03:12:56.700723 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:56.700749 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:56.701259 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:56.701687 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:56.702641 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:56.702650 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:56.702666 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:56.702688 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:56.702769 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:56.702789 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:56.702987 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:56.703114 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 03:12:56.703361 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":334,"threads_started":1}
I20260810 03:12:56.710026 25938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: Bootstrap starting.
I20260810 03:12:56.712852 25938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:56.713757 25938 log.cc:824] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:56.716395 25938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: No bootstrap required, opened a new log
I20260810 03:12:56.723294 25938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } }
I20260810 03:12:56.723592 25938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:56.723662 25938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d1c77bb59841448190c3d2af023389, State: Initialized, Role: FOLLOWER
I20260810 03:12:56.724146 25938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } }
I20260810 03:12:56.724349 25938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:56.724442 25938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:56.724561 25938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:56.726432 25938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } }
I20260810 03:12:56.726836 25938 leader_election.cc:302] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79d1c77bb59841448190c3d2af023389; no voters:
I20260810 03:12:56.727344 25938 leader_election.cc:288] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:56.727464 25946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:56.728120 25946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [term 1 LEADER]: Becoming Leader. State: Replica: 79d1c77bb59841448190c3d2af023389, State: Running, Role: LEADER
I20260810 03:12:56.728622 25946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } }
I20260810 03:12:56.729271 25938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:56.731485 25947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79d1c77bb59841448190c3d2af023389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } } }
I20260810 03:12:56.731521 25948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79d1c77bb59841448190c3d2af023389. Latest consensus state: current_term: 1 leader_uuid: "79d1c77bb59841448190c3d2af023389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79d1c77bb59841448190c3d2af023389" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 42593 } } }
I20260810 03:12:56.731951 25947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:56.731956 25948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389 [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:56.735452 25954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:56.740167 25954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:56.747460 25954 catalog_manager.cc:1347] Generated new cluster ID: d743c36a57454af7a49932a19ee88aeb
I20260810 03:12:56.747556 25954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:56.758456 25954 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:56.758893 25954 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:56.767195 25954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: Generated new TSK 0
I20260810 03:12:56.768133 25954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:12:56.777550 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--builtin_ntp_servers=127.18.112.84:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 03:12:57.096554 25967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:57.096807 25967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:57.096935 25967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:57.104317 25967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:57.104403 25967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:57.104535 25967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:12:57.113145 25967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:57.114243 25967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:57.115933 25967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:57.127882 25979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.127980 25974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.127948 25975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:57.128638 25967 server_base.cc:1034] running on GCE node
I20260810 03:12:57.129197 25967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:57.130123 25967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:57.131315 25967 hybrid_clock.cc:648] HybridClock initialized: now 1786331577131263 us; error 42 us; skew 500 ppm
I20260810 03:12:57.131682 25967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:57.134332 25967 webserver.cc:460] Webserver started at http://127.18.112.65:41281/ using document root <none> and password file <none>
I20260810 03:12:57.135100 25967 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:57.135190 25967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:57.135444 25967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:57.138046 25967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "c3c9e22aea6c4498bf66da1195ef1eb3"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9f80dab32ba6ffe19a1bbc8e46692877"
server_key_iv: "936f981ec71c9c5af4790987124fbdc7"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.138785 25967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "c3c9e22aea6c4498bf66da1195ef1eb3"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9f80dab32ba6ffe19a1bbc8e46692877"
server_key_iv: "936f981ec71c9c5af4790987124fbdc7"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.143564 25967 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260810 03:12:57.146651 25988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.147850 25967 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:57.147979 25967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "c3c9e22aea6c4498bf66da1195ef1eb3"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9f80dab32ba6ffe19a1bbc8e46692877"
server_key_iv: "936f981ec71c9c5af4790987124fbdc7"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.148145 25967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:57.153316 25967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:57.153993 25967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:57.154204 25967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:57.154989 25967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:57.156266 25967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:57.156349 25967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.156425 25967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:57.156477 25967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.185559 25967 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:45969
I20260810 03:12:57.185607 26144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:45969 every 8 connection(s)
I20260810 03:12:57.186817 25967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:12:57.191062 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 25967
I20260810 03:12:57.191285 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:12:57.192103 18881 external_mini_cluster.cc:1428] Setting key b5aaf099018cd5cbb03196a46c43025d
I20260810 03:12:57.194938 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:57.189144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:36209 (local address 127.18.112.126:42593)
0810 03:12:57.189301 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:57.189305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:57.190608 (+ 1303us) server_negotiation.cc:407] Connection header received
0810 03:12:57.192897 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:57.192903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:57.192970 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:57.193056 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:57.194295 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:57.194299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:57.194302 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:57.194317 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:57.194349 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:57.194360 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:57.194444 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:57.194690 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 03:12:57.194743 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:12:57.195307 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--builtin_ntp_servers=127.18.112.84:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 03:12:57.196133 26147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:57.189613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42593 (local address 127.18.112.65:36209)
0810 03:12:57.190458 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:57.190492 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:57.192604 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:57.193282 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:57.193290 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:57.193375 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:57.193976 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:57.193980 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:57.194030 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:57.194137 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:57.194448 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:57.194457 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:57.194466 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 03:12:57.194742 (+ 276us) client_negotiation.cc:240] Negotiation successful
0810 03:12:57.194989 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":253,"threads_started":1}
I20260810 03:12:57.197474 26145 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42593
I20260810 03:12:57.197765 26145 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:57.198381 26145 heartbeater.cc:511] Master 127.18.112.126:42593 requested a full tablet report, sending...
I20260810 03:12:57.200343 25894 ts_manager.cc:194] Registered new tserver with Master: c3c9e22aea6c4498bf66da1195ef1eb3 (127.18.112.65:45969)
W20260810 03:12:57.506981 26148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:57.507258 26148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:57.507385 26148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:57.514467 26148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:57.514564 26148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:57.514714 26148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:12:57.523571 26148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:57.524878 26148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:57.526607 26148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:57.539330 26159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.539288 26157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.539376 26155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:57.540000 26148 server_base.cc:1034] running on GCE node
I20260810 03:12:57.540596 26148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:57.541424 26148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:57.542613 26148 hybrid_clock.cc:648] HybridClock initialized: now 1786331577542553 us; error 49 us; skew 500 ppm
I20260810 03:12:57.542896 26148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:57.544978 26148 webserver.cc:460] Webserver started at http://127.18.112.66:43681/ using document root <none> and password file <none>
I20260810 03:12:57.545584 26148 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:57.545697 26148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:57.545991 26148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:57.548730 26148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "4514cc46b89248a395508dd0d6b93dfc"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9d95491c8dfa27452c096f48149629d6"
server_key_iv: "d8b3320ca391fdbfd86fdb8a0cdbfd58"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.549487 26148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "4514cc46b89248a395508dd0d6b93dfc"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9d95491c8dfa27452c096f48149629d6"
server_key_iv: "d8b3320ca391fdbfd86fdb8a0cdbfd58"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.554412 26148 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:12:57.557559 26172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.558720 26148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:12:57.558869 26148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "4514cc46b89248a395508dd0d6b93dfc"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "9d95491c8dfa27452c096f48149629d6"
server_key_iv: "d8b3320ca391fdbfd86fdb8a0cdbfd58"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.559058 26148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:57.564316 26148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:57.565022 26148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:57.565265 26148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:57.566098 26148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:57.567363 26148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:57.567457 26148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.567564 26148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:57.567642 26148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.596799 26148 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:33671
I20260810 03:12:57.596858 26330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:33671 every 8 connection(s)
I20260810 03:12:57.597949 26148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:12:57.605050 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 26148
I20260810 03:12:57.605258 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:12:57.605813 18881 external_mini_cluster.cc:1428] Setting key b7bf6336a7d00d6f062345623ebc03fc
I20260810 03:12:57.605844 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:57.600229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57105 (local address 127.18.112.126:42593)
0810 03:12:57.600405 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:57.600409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:57.601815 (+ 1406us) server_negotiation.cc:407] Connection header received
0810 03:12:57.603507 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:57.603511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:57.603566 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:57.603656 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:57.604847 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:57.604852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:57.604857 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:57.604878 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:57.604918 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:57.604934 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:57.605025 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:57.605446 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 03:12:57.605548 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:12:57.606616 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:57.600685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42593 (local address 127.18.112.66:57105)
0810 03:12:57.601626 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:57.601679 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:57.603273 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:57.603876 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:57.603886 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:57.603967 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:57.604511 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:57.604513 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:57.604546 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:57.604624 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:57.605121 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:57.605131 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:57.605138 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:12:57.605400 (+ 262us) client_negotiation.cc:240] Negotiation successful
0810 03:12:57.605642 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":258,"threads_started":1}
I20260810 03:12:57.608429 26331 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42593
I20260810 03:12:57.608614 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--builtin_ntp_servers=127.18.112.84:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 03:12:57.608728 26331 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:57.609334 26331 heartbeater.cc:511] Master 127.18.112.126:42593 requested a full tablet report, sending...
I20260810 03:12:57.610699 25894 ts_manager.cc:194] Registered new tserver with Master: 4514cc46b89248a395508dd0d6b93dfc (127.18.112.66:33671)
W20260810 03:12:57.928398 26335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:57.928653 26335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:57.928776 26335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:57.935869 26335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:57.935961 26335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:57.936100 26335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:12:57.945011 26335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:42593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:57.946141 26335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:57.947853 26335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:57.959836 26343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.959875 26348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:57.959906 26344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:57.960796 26335 server_base.cc:1034] running on GCE node
I20260810 03:12:57.961361 26335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:57.962221 26335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:57.963411 26335 hybrid_clock.cc:648] HybridClock initialized: now 1786331577963365 us; error 34 us; skew 500 ppm
I20260810 03:12:57.963721 26335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:57.965788 26335 webserver.cc:460] Webserver started at http://127.18.112.67:45627/ using document root <none> and password file <none>
I20260810 03:12:57.966411 26335 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:57.966513 26335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:57.966835 26335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:57.969517 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "9cbe729e20374af9afad875d2a625024"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "c72f8a89e03d94e9fcb7fded079b09ef"
server_key_iv: "913e5a4d5343920fee62be7d1a4608fc"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.970360 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "9cbe729e20374af9afad875d2a625024"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "c72f8a89e03d94e9fcb7fded079b09ef"
server_key_iv: "913e5a4d5343920fee62be7d1a4608fc"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.975430 26335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 03:12:57.978581 26356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.979745 26335 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:12:57.979913 26335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "9cbe729e20374af9afad875d2a625024"
format_stamp: "Formatted at 2026-08-10 03:12:57 on dist-test-slave-jlzn"
server_key: "c72f8a89e03d94e9fcb7fded079b09ef"
server_key_iv: "913e5a4d5343920fee62be7d1a4608fc"
server_key_version: "encryptionkey@0"
I20260810 03:12:57.980103 26335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:57.985229 26335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:57.985934 26335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:57.986176 26335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:57.986997 26335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:12:57.988348 26335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:12:57.988444 26335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:57.988549 26335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:12:57.988620 26335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:58.017132 26335 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:46549
I20260810 03:12:58.017184 26512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:46549 every 8 connection(s)
I20260810 03:12:58.018366 26335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:12:58.026073 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.020834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:50177 (local address 127.18.112.126:42593)
0810 03:12:58.021029 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.021033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.022319 (+ 1286us) server_negotiation.cc:407] Connection header received
0810 03:12:58.023980 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.023987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.024047 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.024134 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.025389 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.025394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.025399 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.025414 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.025445 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.025457 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.025565 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.025738 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.025808 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:12:58.026887 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.021306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:42593 (local address 127.18.112.67:50177)
0810 03:12:58.022166 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.022213 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.023695 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.024403 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.024411 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.024502 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.025101 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.025103 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.025148 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.025228 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.025540 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.025552 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.025559 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.025807 (+ 248us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.026035 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":257,"threads_started":1}
I20260810 03:12:58.027881 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 26335
I20260810 03:12:58.028036 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:12:58.028162 26513 heartbeater.cc:347] Connected to a master server at 127.18.112.126:42593
I20260810 03:12:58.028457 26513 heartbeater.cc:464] Registering TS with master...
I20260810 03:12:58.028574 18881 external_mini_cluster.cc:1428] Setting key ed05a0a3ca17bec3d69dd7c72db123c5
I20260810 03:12:58.029147 26513 heartbeater.cc:511] Master 127.18.112.126:42593 requested a full tablet report, sending...
I20260810 03:12:58.030550 25894 ts_manager.cc:194] Registered new tserver with Master: 9cbe729e20374af9afad875d2a625024 (127.18.112.67:46549)
I20260810 03:12:58.031739 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:12:58.038158 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.036139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60008 (local address 127.18.112.126:42593)
0810 03:12:58.036273 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.036277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.036762 (+ 485us) server_negotiation.cc:407] Connection header received
0810 03:12:58.036883 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.036886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.036927 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.036999 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.037729 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.037733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.037735 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.037749 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.037776 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.037787 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.037873 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.037907 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.037947 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:12:58.041666 25891 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:12:58.048069 25891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:12:58.064211 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.059109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41258 (local address 127.18.112.67:46549)
0810 03:12:58.060406 (+ 1297us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.060415 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.060450 (+ 35us) server_negotiation.cc:407] Connection header received
0810 03:12:58.060520 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.060528 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.060748 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.061626 (+ 878us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.063268 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.063277 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.063291 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.063307 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.063415 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.063440 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.063616 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.063734 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.063864 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1134,"thread_start_us":968,"threads_started":1}
I20260810 03:12:58.064325 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.060273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33671 (local address 127.0.0.1:34804)
0810 03:12:58.060786 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.060805 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.060904 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.061772 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.061776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.061797 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.062415 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.062418 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.062435 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.062477 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.063700 (+ 1223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.063704 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.063709 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.063843 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.063895 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":235,"threads_started":1}
I20260810 03:12:58.064847 26532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.058921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:46549 (local address 127.0.0.1:41258)
0810 03:12:58.059916 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.059957 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.060098 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.060998 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.061006 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.061203 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.062011 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.062014 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.062053 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.062160 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.063549 (+ 1389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.063560 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.063569 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.063756 (+ 187us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.063868 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":574,"threads_started":1}
I20260810 03:12:58.065583 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.060554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34804 (local address 127.18.112.66:33671)
0810 03:12:58.061334 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.061348 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.061369 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:12:58.061420 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.061425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.061588 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.062209 (+ 621us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.063464 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.063472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.063483 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.063499 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.063552 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.063575 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.065118 (+ 1543us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.065187 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.065287 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":520,"threads_started":1}
I20260810 03:12:58.066618 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.061348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.18.112.65:45969)
0810 03:12:58.061860 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.061868 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.063672 (+ 1804us) server_negotiation.cc:407] Connection header received
0810 03:12:58.063922 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.063929 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.064119 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.064238 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.065864 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.065873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.065885 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.065905 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.065965 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.065988 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.066120 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.066250 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.066342 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":539,"threads_started":1}
I20260810 03:12:58.066759 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.060817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45969 (local address 127.0.0.1:45862)
0810 03:12:58.063563 (+ 2746us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.063579 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.063755 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.064826 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.064829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.064850 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.065534 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.065536 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.065548 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.065581 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.066120 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.066125 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.066131 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.066279 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.066324 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2605,"thread_start_us":2462,"threads_started":1}
I20260810 03:12:58.068311 26428 tablet_service.cc:1467] Processing CreateTablet for tablet 194eb79c7123452b955ae9dc3e305e3e (DEFAULT_TABLE table=test-table [id=049639d258a9481ebb9fb5bed1927524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:58.069839 26428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 194eb79c7123452b955ae9dc3e305e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:58.070981 26234 tablet_service.cc:1467] Processing CreateTablet for tablet 194eb79c7123452b955ae9dc3e305e3e (DEFAULT_TABLE table=test-table [id=049639d258a9481ebb9fb5bed1927524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:58.071211 26058 tablet_service.cc:1467] Processing CreateTablet for tablet 194eb79c7123452b955ae9dc3e305e3e (DEFAULT_TABLE table=test-table [id=049639d258a9481ebb9fb5bed1927524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:12:58.072361 26058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 194eb79c7123452b955ae9dc3e305e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:58.072378 26234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 194eb79c7123452b955ae9dc3e305e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:58.083170 26539 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Bootstrap starting.
I20260810 03:12:58.085042 26540 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Bootstrap starting.
I20260810 03:12:58.086383 26541 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Bootstrap starting.
I20260810 03:12:58.087273 26539 tablet_bootstrap.cc:654] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:58.088447 26540 tablet_bootstrap.cc:654] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:58.088593 26539 log.cc:824] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:58.089553 26540 log.cc:824] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:58.089651 26541 tablet_bootstrap.cc:654] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:58.090804 26541 log.cc:824] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:58.091460 26539 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: No bootstrap required, opened a new log
I20260810 03:12:58.091741 26539 ts_tablet_manager.cc:1397] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 03:12:58.092491 26540 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: No bootstrap required, opened a new log
I20260810 03:12:58.092756 26540 ts_tablet_manager.cc:1397] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:12:58.093140 26541 tablet_bootstrap.cc:492] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: No bootstrap required, opened a new log
I20260810 03:12:58.093356 26541 ts_tablet_manager.cc:1397] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260810 03:12:58.100208 26541 raft_consensus.cc:348] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.100535 26541 raft_consensus.cc:374] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:58.100636 26541 raft_consensus.cc:729] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4514cc46b89248a395508dd0d6b93dfc, State: Initialized, Role: FOLLOWER
I20260810 03:12:58.101167 26541 consensus_queue.cc:260] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.101703 26539 raft_consensus.cc:348] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.102090 26539 raft_consensus.cc:374] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:58.102175 26331 heartbeater.cc:503] Master 127.18.112.126:42593 was elected leader, sending a full tablet report...
I20260810 03:12:58.102201 26539 raft_consensus.cc:729] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c9e22aea6c4498bf66da1195ef1eb3, State: Initialized, Role: FOLLOWER
I20260810 03:12:58.102741 26541 ts_tablet_manager.cc:1428] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260810 03:12:58.102837 26539 consensus_queue.cc:260] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.103933 26145 heartbeater.cc:503] Master 127.18.112.126:42593 was elected leader, sending a full tablet report...
I20260810 03:12:58.104296 26540 raft_consensus.cc:348] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.104600 26540 raft_consensus.cc:374] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:58.104708 26540 raft_consensus.cc:729] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cbe729e20374af9afad875d2a625024, State: Initialized, Role: FOLLOWER
I20260810 03:12:58.105247 26540 consensus_queue.cc:260] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.105681 26539 ts_tablet_manager.cc:1428] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260810 03:12:58.106495 26513 heartbeater.cc:503] Master 127.18.112.126:42593 was elected leader, sending a full tablet report...
I20260810 03:12:58.107113 26540 ts_tablet_manager.cc:1428] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
W20260810 03:12:58.188840 26146 tablet.cc:2369] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:58.200181 26548 raft_consensus.cc:482] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:12:58.200438 26548 raft_consensus.cc:504] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.201970 26548 leader_election.cc:288] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cbe729e20374af9afad875d2a625024 (127.18.112.67:46549), 4514cc46b89248a395508dd0d6b93dfc (127.18.112.66:33671)
I20260810 03:12:58.205008 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.202336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39151 (local address 127.18.112.67:46549)
0810 03:12:58.202494 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.202499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.203047 (+ 548us) server_negotiation.cc:407] Connection header received
0810 03:12:58.203202 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.203208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.203279 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.203378 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.204474 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.204479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.204482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.204498 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.204538 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.204555 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.204683 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.204754 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.204816 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:12:58.205274 26550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.202336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:46549 (local address 127.18.112.65:39151)
0810 03:12:58.202926 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.202943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.203067 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.203520 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.203526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.203548 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.204275 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.204277 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.204292 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.204335 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.204662 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.204666 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.204669 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.204790 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.204843 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":306,"threads_started":1}
I20260810 03:12:58.205544 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.203235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:38279 (local address 127.18.112.66:33671)
0810 03:12:58.203414 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.203421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.203693 (+ 272us) server_negotiation.cc:407] Connection header received
0810 03:12:58.203856 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.203859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.203908 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.203997 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.204879 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.204885 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.204889 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.204908 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.204946 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.204962 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.205078 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.205255 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.205315 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:12:58.206104 26554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.203021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33671 (local address 127.18.112.65:38279)
0810 03:12:58.203569 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:58.203584 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:58.203714 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:58.204039 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:58.204043 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:58.204067 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:12:58.204651 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:12:58.204653 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:12:58.204670 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:12:58.204714 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:12:58.205067 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:12:58.205071 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:12:58.205076 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:12:58.205778 (+ 702us) client_negotiation.cc:240] Negotiation successful
0810 03:12:58.205829 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":265,"threads_started":1}
I20260810 03:12:58.206239 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "194eb79c7123452b955ae9dc3e305e3e" candidate_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cbe729e20374af9afad875d2a625024" is_pre_election: true
I20260810 03:12:58.206733 26455 raft_consensus.cc:2454] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c9e22aea6c4498bf66da1195ef1eb3 in term 0.
I20260810 03:12:58.206887 26268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "194eb79c7123452b955ae9dc3e305e3e" candidate_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4514cc46b89248a395508dd0d6b93dfc" is_pre_election: true
I20260810 03:12:58.207306 26268 raft_consensus.cc:2454] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3c9e22aea6c4498bf66da1195ef1eb3 in term 0.
I20260810 03:12:58.207350 25989 leader_election.cc:302] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cbe729e20374af9afad875d2a625024, c3c9e22aea6c4498bf66da1195ef1eb3; no voters:
I20260810 03:12:58.207690 26548 raft_consensus.cc:2781] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:12:58.207861 26548 raft_consensus.cc:482] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:12:58.207970 26548 raft_consensus.cc:3037] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:58.210014 26548 raft_consensus.cc:504] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.210559 26548 leader_election.cc:288] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [CANDIDATE]: Term 1 election: Requested vote from peers 9cbe729e20374af9afad875d2a625024 (127.18.112.67:46549), 4514cc46b89248a395508dd0d6b93dfc (127.18.112.66:33671)
I20260810 03:12:58.210963 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "194eb79c7123452b955ae9dc3e305e3e" candidate_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cbe729e20374af9afad875d2a625024"
I20260810 03:12:58.211031 26268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "194eb79c7123452b955ae9dc3e305e3e" candidate_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4514cc46b89248a395508dd0d6b93dfc"
I20260810 03:12:58.211163 26455 raft_consensus.cc:3037] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:58.211220 26268 raft_consensus.cc:3037] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:58.214321 26268 raft_consensus.cc:2454] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c9e22aea6c4498bf66da1195ef1eb3 in term 1.
I20260810 03:12:58.214321 26455 raft_consensus.cc:2454] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3c9e22aea6c4498bf66da1195ef1eb3 in term 1.
I20260810 03:12:58.214692 25989 leader_election.cc:302] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4514cc46b89248a395508dd0d6b93dfc, c3c9e22aea6c4498bf66da1195ef1eb3; no voters:
I20260810 03:12:58.214972 26548 raft_consensus.cc:2781] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:58.215384 26548 raft_consensus.cc:686] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 1 LEADER]: Becoming Leader. State: Replica: c3c9e22aea6c4498bf66da1195ef1eb3, State: Running, Role: LEADER
I20260810 03:12:58.215843 26548 consensus_queue.cc:237] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } }
I20260810 03:12:58.220263 25894 catalog_manager.cc:5495] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3c9e22aea6c4498bf66da1195ef1eb3 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3c9e22aea6c4498bf66da1195ef1eb3" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45969 } health_report { overall_health: HEALTHY } } }
I20260810 03:12:58.255791 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.254005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45864 (local address 127.18.112.65:45969)
0810 03:12:58.254207 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.254211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.254244 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:12:58.254414 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.254418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.254493 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.254567 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.255276 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.255280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.255283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.255297 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.255328 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.255339 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.255425 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.255489 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.255533 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:12:58.263492 26455 raft_consensus.cc:1261] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 1 FOLLOWER]: Refusing update from remote peer c3c9e22aea6c4498bf66da1195ef1eb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:58.263489 26268 raft_consensus.cc:1261] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 1 FOLLOWER]: Refusing update from remote peer c3c9e22aea6c4498bf66da1195ef1eb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:12:58.264426 26556 consensus_queue.cc:1035] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cbe729e20374af9afad875d2a625024" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 46549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:12:58.264809 26548 consensus_queue.cc:1035] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4514cc46b89248a395508dd0d6b93dfc" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:12:58.269847 26516 tablet.cc:2369] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:12:58.288311 25891 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:58.288595 25891 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:12:58.292006 25891 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79d1c77bb59841448190c3d2af023389: Sending DeleteTablet for 3 replicas of tablet 194eb79c7123452b955ae9dc3e305e3e
I20260810 03:12:58.292997 26428 tablet_service.cc:1514] Processing DeleteTablet for tablet 194eb79c7123452b955ae9dc3e305e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:58 UTC) from {username='slave'} at 127.0.0.1:41258
I20260810 03:12:58.293152 26234 tablet_service.cc:1514] Processing DeleteTablet for tablet 194eb79c7123452b955ae9dc3e305e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:58 UTC) from {username='slave'} at 127.0.0.1:34804
I20260810 03:12:58.293291 26058 tablet_service.cc:1514] Processing DeleteTablet for tablet 194eb79c7123452b955ae9dc3e305e3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:12:58 UTC) from {username='slave'} at 127.0.0.1:45862
I20260810 03:12:58.295235 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25967
I20260810 03:12:58.308537 26575 tablet_replica.cc:330] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: stopping tablet replica
I20260810 03:12:58.308975 26575 raft_consensus.cc:2229] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:12:58.309602 26575 raft_consensus.cc:2258] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:58.311506 26575 ts_tablet_manager.cc:1905] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:58.319254 26575 ts_tablet_manager.cc:1918] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:58.319428 26575 log.cc:1196] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/194eb79c7123452b955ae9dc3e305e3e
I20260810 03:12:58.320020 26575 ts_tablet_manager.cc:1939] T 194eb79c7123452b955ae9dc3e305e3e P c3c9e22aea6c4498bf66da1195ef1eb3: Deleting consensus metadata
I20260810 03:12:58.321698 25864 catalog_manager.cc:4841] TS c3c9e22aea6c4498bf66da1195ef1eb3 (127.18.112.65:45969): tablet 194eb79c7123452b955ae9dc3e305e3e (table test-table [id=049639d258a9481ebb9fb5bed1927524]) successfully deleted
I20260810 03:12:58.322186 26574 tablet_replica.cc:330] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: stopping tablet replica
I20260810 03:12:58.323004 26574 raft_consensus.cc:2229] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:58.323587 26574 raft_consensus.cc:2258] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:58.323978 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.296660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45872 (local address 127.18.112.65:45969)
0810 03:12:58.296832 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.296838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.320771 (+ 23933us) server_negotiation.cc:407] Connection header received
0810 03:12:58.321223 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.321229 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.321291 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.321360 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.323089 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.323095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.323100 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.323119 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.323157 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.323173 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.323262 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.323545 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.323613 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:12:58.324887 26573 tablet_replica.cc:330] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: stopping tablet replica
I20260810 03:12:58.325090 26137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:58.325270 26573 raft_consensus.cc:2229] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:12:58.325729 26573 raft_consensus.cc:2258] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:12:58.326110 26574 ts_tablet_manager.cc:1905] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:58.327982 26573 ts_tablet_manager.cc:1905] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:12:58.333638 26574 ts_tablet_manager.cc:1918] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:58.333801 26574 log.cc:1196] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/194eb79c7123452b955ae9dc3e305e3e
I20260810 03:12:58.334322 26574 ts_tablet_manager.cc:1939] T 194eb79c7123452b955ae9dc3e305e3e P 4514cc46b89248a395508dd0d6b93dfc: Deleting consensus metadata
I20260810 03:12:58.335134 26573 ts_tablet_manager.cc:1918] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:12:58.335286 26573 log.cc:1196] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/194eb79c7123452b955ae9dc3e305e3e
I20260810 03:12:58.335821 26573 ts_tablet_manager.cc:1939] T 194eb79c7123452b955ae9dc3e305e3e P 9cbe729e20374af9afad875d2a625024: Deleting consensus metadata
I20260810 03:12:58.336051 25864 catalog_manager.cc:4841] TS 4514cc46b89248a395508dd0d6b93dfc (127.18.112.66:33671): tablet 194eb79c7123452b955ae9dc3e305e3e (table test-table [id=049639d258a9481ebb9fb5bed1927524]) successfully deleted
I20260810 03:12:58.337191 25864 catalog_manager.cc:4841] TS 9cbe729e20374af9afad875d2a625024 (127.18.112.67:46549): tablet 194eb79c7123452b955ae9dc3e305e3e (table test-table [id=049639d258a9481ebb9fb5bed1927524]) successfully deleted
I20260810 03:12:58.420475 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25967
I20260810 03:12:58.444176 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 26148
I20260810 03:12:58.446588 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.444888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34812 (local address 127.18.112.66:33671)
0810 03:12:58.445049 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.445053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.445071 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:12:58.445214 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.445218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.445308 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.445395 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.446124 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.446129 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.446133 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.446149 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.446182 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.446194 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.446293 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.446328 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.446373 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:12:58.447190 26324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:58.531689 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 26148
I20260810 03:12:58.556624 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 26335
I20260810 03:12:58.559358 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:58.557382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.18.112.67:46549)
0810 03:12:58.557608 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:58.557614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:58.557634 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:12:58.557775 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:58.557779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:58.557860 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:58.557945 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:58.558719 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:58.558725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:58.558729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:58.558749 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:58.558783 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:58.558795 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:58.558906 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:58.559006 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 03:12:58.559066 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:12:58.560010 26505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:58.645170 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 26335
I20260810 03:12:58.670193 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 25847
I20260810 03:12:58.671305 25931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:58.774575 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 25847
2026-08-10T03:12:58Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2536 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 03:12:58.821727 18881 mini_oidc.cc:152] Starting JWKS server
I20260810 03:12:58.824419 18881 webserver.cc:460] Webserver started at https://127.0.0.1:37235/ using document root <none> and password file <none>
I20260810 03:12:58.824715 18881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:12:58.825304 18881 webserver.cc:460] Webserver started at http://127.0.0.1:41363/ using document root <none> and password file <none>
2026-08-10T03:12:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:58Z Disabled control of system clock
I20260810 03:12:58.853708 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43019
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:37229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:43019
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37235/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/testchainca.cert with env {}
W20260810 03:12:59.166610 26592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:59.166877 26592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:59.166970 26592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:59.173976 26592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:59.174073 26592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:59.174117 26592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:59.174172 26592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:59.174216 26592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:12:59.174273 26592 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:12:59.174311 26592 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37235/jwks.json
I20260810 03:12:59.183688 26592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:43019
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37235/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:59.184818 26592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:59.185995 26592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:59.196848 26600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:59.196825 26603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:59.196882 26599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:59.197747 26592 server_base.cc:1034] running on GCE node
I20260810 03:12:59.198495 26592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:59.199735 26592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:59.200953 26592 hybrid_clock.cc:648] HybridClock initialized: now 1786331579200910 us; error 35 us; skew 500 ppm
I20260810 03:12:59.201247 26592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:59.203320 26592 webserver.cc:460] Webserver started at http://127.18.112.126:33803/ using document root <none> and password file <none>
I20260810 03:12:59.203958 26592 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:59.204059 26592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:59.204313 26592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:59.207103 26592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "343672e343594ef58e9c569d5cebc8ca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "9186816ff637ddbe5f05421493eeda91"
server_key_iv: "9b8d43725ecd898cf91bab26145968b1"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.207916 26592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "343672e343594ef58e9c569d5cebc8ca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "9186816ff637ddbe5f05421493eeda91"
server_key_iv: "9b8d43725ecd898cf91bab26145968b1"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.212620 26592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:12:59.215711 26611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:59.216920 26592 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:12:59.217075 26592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "343672e343594ef58e9c569d5cebc8ca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "9186816ff637ddbe5f05421493eeda91"
server_key_iv: "9b8d43725ecd898cf91bab26145968b1"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.217240 26592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:59.250648 26592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:59.251308 26592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:59.251565 26592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:59.268051 26592 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:43019
I20260810 03:12:59.268070 26682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:43019 every 8 connection(s)
I20260810 03:12:59.269235 26592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:59.272640 26683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:59.279682 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 26592
I20260810 03:12:59.279882 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:59.280501 18881 external_mini_cluster.cc:1428] Setting key bbacab45dc1df794752f683eb9c4f0bb
I20260810 03:12:59.282310 26683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: Bootstrap starting.
I20260810 03:12:59.285377 26683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: Neither blocks nor log segments found. Creating new log.
I20260810 03:12:59.286644 26683 log.cc:824] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: Log is configured to *not* fsync() on all Append() calls
I20260810 03:12:59.289656 26683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: No bootstrap required, opened a new log
I20260810 03:12:59.293725 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:59.282279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52644 (local address 127.18.112.126:43019)
0810 03:12:59.283193 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:59.283203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:59.283242 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:12:59.284902 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:59.284923 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:59.285332 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:59.285640 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:12:59.286214 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.287774 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.289628 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.290301 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.290419 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:59.291578 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:12:59.291585 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:12:59.291601 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:12:59.292163 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:12:59.292237 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:12:59.292260 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:12:59.292352 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:12:59.292560 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 03:12:59.292844 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":310,"threads_started":1}
I20260810 03:12:59.297075 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:12:59.297528 26683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } }
I20260810 03:12:59.297900 26683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:12:59.298000 26683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343672e343594ef58e9c569d5cebc8ca, State: Initialized, Role: FOLLOWER
I20260810 03:12:59.298552 26683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } }
I20260810 03:12:59.298810 26683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:12:59.298924 26683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:12:59.299080 26683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:12:59.301333 26683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } }
I20260810 03:12:59.301752 26683 leader_election.cc:302] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 343672e343594ef58e9c569d5cebc8ca; no voters:
I20260810 03:12:59.302207 26683 leader_election.cc:288] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:12:59.302311 26690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:12:59.302994 26690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [term 1 LEADER]: Becoming Leader. State: Replica: 343672e343594ef58e9c569d5cebc8ca, State: Running, Role: LEADER
I20260810 03:12:59.303442 26690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } }
I20260810 03:12:59.304059 26683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:12:59.307214 26691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "343672e343594ef58e9c569d5cebc8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } } }
I20260810 03:12:59.307260 26694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 343672e343594ef58e9c569d5cebc8ca. Latest consensus state: current_term: 1 leader_uuid: "343672e343594ef58e9c569d5cebc8ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "343672e343594ef58e9c569d5cebc8ca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43019 } } }
I20260810 03:12:59.307863 26694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [sys.catalog]: This master's current role is: LEADER
I20260810 03:12:59.308382 26691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca [sys.catalog]: This master's current role is: LEADER
W20260810 03:12:59.315246 26716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:12:59.315351 26716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:12:59.315474 26712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:12:59.317063 26712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:12:59.324460 26712 catalog_manager.cc:1347] Generated new cluster ID: 1620df5d8be648be880e05bd5c0761ad
I20260810 03:12:59.324553 26712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:12:59.335954 26712 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:12:59.337050 26712 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:12:59.345352 26712 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 343672e343594ef58e9c569d5cebc8ca: Generated new TSK 0
I20260810 03:12:59.346019 26712 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 03:12:59.384387 26730 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 03:12:59.384516 26730 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 03:12:59.385640 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:59.364927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52660 (local address 127.18.112.126:43019)
0810 03:12:59.365113 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:59.365119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:59.365567 (+ 448us) server_negotiation.cc:407] Connection header received
0810 03:12:59.365844 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:12:59.365850 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:12:59.365941 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:12:59.366090 (+ 149us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:12:59.366547 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.367652 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.369026 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.369687 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.369806 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:59.370247 (+ 441us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:12:59.385003 (+ 14756us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 03:12:59.385321 (+ 318us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52660: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 03:12:59.385790 26686 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52660: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 03:12:59.386986 26729 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:12:59.364836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43019 (local address 127.0.0.1:52660)
0810 03:12:59.365475 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0810 03:12:59.365490 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:12:59.365623 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:12:59.366096 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:12:59.366099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:12:59.366108 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:12:59.366410 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:59.366418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.367772 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.367776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:59.368887 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:12:59.368899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:12:59.369820 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:12:59.369824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:12:59.369944 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:12:59.369995 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:12:59.385239 (+ 15244us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 03:12:59.385469 (+ 230us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.112.126:43019: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":331,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.18.112.126:43019: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37235/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 03:12:59.388787 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 26592
I20260810 03:12:59.389732 26677 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:12:59.479591 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 26592
2026-08-10T03:12:59Z chronyd exiting
I20260810 03:12:59.534610 18881 test_util.cc:175] -----------------------------------------------
I20260810 03:12:59.534732 18881 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786331536832683-18881-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (717 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 03:12:59.538483 18881 mini_oidc.cc:152] Starting JWKS server
I20260810 03:12:59.540334 18881 webserver.cc:460] Webserver started at https://127.0.0.1:41499/ using document root <none> and password file <none>
I20260810 03:12:59.540551 18881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:12:59.541113 18881 webserver.cc:460] Webserver started at http://127.0.0.1:39183/ using document root <none> and password file <none>
2026-08-10T03:12:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:12:59Z Disabled control of system clock
I20260810 03:12:59.569742 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:45823
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:36923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:45823
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41499/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/testchainca.cert with env {}
W20260810 03:12:59.890568 26741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:12:59.890888 26741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:12:59.891024 26741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:12:59.898142 26741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:12:59.898252 26741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:12:59.898313 26741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:12:59.898392 26741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:12:59.898448 26741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:12:59.898530 26741 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:12:59.898581 26741 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41499/jwks.json
I20260810 03:12:59.908092 26741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:45823
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:45823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41499/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:12:59.909278 26741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:12:59.910526 26741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:12:59.921406 26747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:59.921438 26758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:12:59.921492 26750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:12:59.922420 26741 server_base.cc:1034] running on GCE node
I20260810 03:12:59.923148 26741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:12:59.924459 26741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:12:59.925662 26741 hybrid_clock.cc:648] HybridClock initialized: now 1786331579925620 us; error 34 us; skew 500 ppm
I20260810 03:12:59.925959 26741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:12:59.928074 26741 webserver.cc:460] Webserver started at http://127.18.112.126:45515/ using document root <none> and password file <none>
I20260810 03:12:59.928673 26741 fs_manager.cc:359] Metadata directory not provided
I20260810 03:12:59.928762 26741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:12:59.929004 26741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:12:59.931767 26741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "48aad5ae28e14d7891e0b9f351eecfca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "940e8916e87f43ff511b456736a7ba71"
server_key_iv: "95b759e81db411f7eaa25819f98d9408"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.932610 26741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "48aad5ae28e14d7891e0b9f351eecfca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "940e8916e87f43ff511b456736a7ba71"
server_key_iv: "95b759e81db411f7eaa25819f98d9408"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.937562 26741 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:12:59.940677 26768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:12:59.942019 26741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:12:59.942188 26741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "48aad5ae28e14d7891e0b9f351eecfca"
format_stamp: "Formatted at 2026-08-10 03:12:59 on dist-test-slave-jlzn"
server_key: "940e8916e87f43ff511b456736a7ba71"
server_key_iv: "95b759e81db411f7eaa25819f98d9408"
server_key_version: "encryptionkey@0"
I20260810 03:12:59.942368 26741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:12:59.973135 26741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:12:59.973834 26741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:12:59.974084 26741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:12:59.989779 26741 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:45823
I20260810 03:12:59.989799 26834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:45823 every 8 connection(s)
I20260810 03:12:59.990935 26741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:12:59.994398 26835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:12:59.995975 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 26741
I20260810 03:12:59.996204 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:12:59.997014 18881 external_mini_cluster.cc:1428] Setting key be24a33cc25569d57b316f4d1c8d905b
I20260810 03:13:00.006197 26835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca: Bootstrap starting.
I20260810 03:13:00.009594 26835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:00.010108 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:12:59.998808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59382 (local address 127.18.112.126:45823)
0810 03:12:59.999774 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0810 03:12:59.999785 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:12:59.999854 (+ 69us) server_negotiation.cc:407] Connection header received
0810 03:13:00.001514 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:00.001534 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:00.001942 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:00.002232 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:00.002793 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.004196 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.005955 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.006645 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.006769 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.007981 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:00.007989 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:00.008001 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:00.008483 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:00.008567 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:00.008591 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:00.008700 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:00.008913 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 03:13:00.009204 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":373,"threads_started":1}
I20260810 03:13:00.010618 26835 log.cc:824] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:00.013561 26835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca: No bootstrap required, opened a new log
I20260810 03:13:00.013693 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:13:00.021358 26835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } }
I20260810 03:13:00.021660 26835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:00.021742 26835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48aad5ae28e14d7891e0b9f351eecfca, State: Initialized, Role: FOLLOWER
I20260810 03:13:00.022184 26835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } }
I20260810 03:13:00.022455 26835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:00.022586 26835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:00.022773 26835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:00.024813 26835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } }
I20260810 03:13:00.025244 26835 leader_election.cc:302] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48aad5ae28e14d7891e0b9f351eecfca; no voters:
I20260810 03:13:00.025749 26835 leader_election.cc:288] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:00.025852 26841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:00.026453 26841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [term 1 LEADER]: Becoming Leader. State: Replica: 48aad5ae28e14d7891e0b9f351eecfca, State: Running, Role: LEADER
I20260810 03:13:00.026933 26841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } }
I20260810 03:13:00.027554 26835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:00.029338 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48aad5ae28e14d7891e0b9f351eecfca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } } }
I20260810 03:13:00.029479 26844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48aad5ae28e14d7891e0b9f351eecfca. Latest consensus state: current_term: 1 leader_uuid: "48aad5ae28e14d7891e0b9f351eecfca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48aad5ae28e14d7891e0b9f351eecfca" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45823 } } }
I20260810 03:13:00.029713 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:00.029765 26844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:00.032689 26850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:00.037428 26850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:00.045662 26850 catalog_manager.cc:1347] Generated new cluster ID: 22f5bc607ec64cffb41521331e6229ef
I20260810 03:13:00.045766 26850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:00.059374 26850 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:00.060881 26850 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:00.067376 26850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48aad5ae28e14d7891e0b9f351eecfca: Generated new TSK 0
I20260810 03:13:00.068087 26850 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 03:13:00.099645 26874 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 03:13:00.099748 26874 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 03:13:00.100996 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:00.081503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59384 (local address 127.18.112.126:45823)
0810 03:13:00.081685 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:00.081691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:00.082000 (+ 309us) server_negotiation.cc:407] Connection header received
0810 03:13:00.082202 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:00.082208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:00.082304 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:00.082459 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:13:00.082878 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.083997 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.085327 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.086059 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.086188 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.086626 (+ 438us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:13:00.100333 (+ 13707us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 03:13:00.100712 (+ 379us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 03:13:00.101017 26873 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:00.081365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:45823 (local address 127.0.0.1:59384)
0810 03:13:00.081906 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:00.081922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:00.082033 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:00.082462 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:00.082465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:00.082473 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:13:00.082726 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:00.082734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.084119 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.084122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:00.085188 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:00.085200 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.086211 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.086215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:00.086339 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.086368 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:13:00.100528 (+ 14160us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 03:13:00.100734 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.112.126:45823: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":297,"threads_started":1}
W20260810 03:13:00.101112 26839 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260810 03:13:00.102376 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 26741
I20260810 03:13:00.103436 26826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:00.194530 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 26741
2026-08-10T03:13:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (715 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 03:13:00.254480 18881 mini_oidc.cc:152] Starting JWKS server
I20260810 03:13:00.256366 18881 webserver.cc:460] Webserver started at https://127.0.0.1:38193/ using document root <none> and password file <none>
I20260810 03:13:00.256583 18881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:13:00.257177 18881 webserver.cc:460] Webserver started at http://127.0.0.1:46109/ using document root <none> and password file <none>
2026-08-10T03:13:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:00Z Disabled control of system clock
I20260810 03:13:00.285346 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:38245
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:44017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:38245
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38193/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 03:13:00.595131 26885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:00.595407 26885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:00.595543 26885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:00.602427 26885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:00.602541 26885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:00.602607 26885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:00.602686 26885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:00.602752 26885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:13:00.602833 26885 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:13:00.602888 26885 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38193/jwks.json
I20260810 03:13:00.611440 26885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:38245
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:38245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38193/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:00.612591 26885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:00.614269 26885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:00.625242 26890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:00.625298 26892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:00.625327 26895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:00.626066 26885 server_base.cc:1034] running on GCE node
I20260810 03:13:00.626782 26885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:00.628113 26885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:00.629324 26885 hybrid_clock.cc:648] HybridClock initialized: now 1786331580629281 us; error 35 us; skew 500 ppm
I20260810 03:13:00.629668 26885 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:00.634509 26885 webserver.cc:460] Webserver started at http://127.18.112.126:36883/ using document root <none> and password file <none>
I20260810 03:13:00.635133 26885 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:00.635221 26885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:00.635499 26885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:00.638266 26885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "f98ac757b068473db688174ed15e3a57"
format_stamp: "Formatted at 2026-08-10 03:13:00 on dist-test-slave-jlzn"
server_key: "0da336a8b17549b420641166f122d793"
server_key_iv: "4df3ab14dba34be32b54408053079ca3"
server_key_version: "encryptionkey@0"
I20260810 03:13:00.639007 26885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "f98ac757b068473db688174ed15e3a57"
format_stamp: "Formatted at 2026-08-10 03:13:00 on dist-test-slave-jlzn"
server_key: "0da336a8b17549b420641166f122d793"
server_key_iv: "4df3ab14dba34be32b54408053079ca3"
server_key_version: "encryptionkey@0"
I20260810 03:13:00.643714 26885 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260810 03:13:00.646836 26902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:00.648128 26885 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:13:00.648274 26885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "f98ac757b068473db688174ed15e3a57"
format_stamp: "Formatted at 2026-08-10 03:13:00 on dist-test-slave-jlzn"
server_key: "0da336a8b17549b420641166f122d793"
server_key_iv: "4df3ab14dba34be32b54408053079ca3"
server_key_version: "encryptionkey@0"
I20260810 03:13:00.648458 26885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:00.688325 26885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:00.689119 26885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:00.689407 26885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:00.706185 26885 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:38245
I20260810 03:13:00.706208 26973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:38245 every 8 connection(s)
I20260810 03:13:00.707475 26885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:00.710354 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 26885
I20260810 03:13:00.710549 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:00.711349 18881 external_mini_cluster.cc:1428] Setting key 27891c829b5f639e0a4e3b4cdb08fdb9
I20260810 03:13:00.711401 26974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:00.724277 26974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57: Bootstrap starting.
I20260810 03:13:00.724565 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:00.713233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.18.112.126:38245)
0810 03:13:00.714160 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:00.714170 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:00.714219 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:13:00.715932 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:00.715954 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:00.716385 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:00.716700 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:00.717279 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.718671 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.720415 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.721085 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.721223 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.722391 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:00.722398 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:00.722410 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:00.722895 (+ 485us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:00.722985 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:00.723014 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:00.723101 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:00.723319 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 03:13:00.723594 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":323,"threads_started":1}
I20260810 03:13:00.727288 26974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:00.727995 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:13:00.728392 26974 log.cc:824] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:00.731181 26974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57: No bootstrap required, opened a new log
I20260810 03:13:00.737963 26974 raft_consensus.cc:348] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } }
I20260810 03:13:00.738276 26974 raft_consensus.cc:374] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:00.738368 26974 raft_consensus.cc:729] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98ac757b068473db688174ed15e3a57, State: Initialized, Role: FOLLOWER
I20260810 03:13:00.738864 26974 consensus_queue.cc:260] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } }
I20260810 03:13:00.739068 26974 raft_consensus.cc:388] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:00.739193 26974 raft_consensus.cc:482] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:00.739331 26974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:00.741413 26974 raft_consensus.cc:504] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } }
I20260810 03:13:00.741863 26974 leader_election.cc:302] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f98ac757b068473db688174ed15e3a57; no voters:
I20260810 03:13:00.742364 26974 leader_election.cc:288] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:00.742479 26981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:00.743117 26981 raft_consensus.cc:686] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [term 1 LEADER]: Becoming Leader. State: Replica: f98ac757b068473db688174ed15e3a57, State: Running, Role: LEADER
I20260810 03:13:00.743671 26981 consensus_queue.cc:237] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } }
I20260810 03:13:00.744278 26974 sys_catalog.cc:564] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:00.746559 26982 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f98ac757b068473db688174ed15e3a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } } }
I20260810 03:13:00.746529 26983 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f98ac757b068473db688174ed15e3a57. Latest consensus state: current_term: 1 leader_uuid: "f98ac757b068473db688174ed15e3a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98ac757b068473db688174ed15e3a57" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 38245 } } }
I20260810 03:13:00.746876 26982 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:00.746889 26983 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:00.748260 26990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:00.752697 26990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:00.760100 26990 catalog_manager.cc:1347] Generated new cluster ID: afbeaac251624b58952e818f83edfbb7
I20260810 03:13:00.760212 26990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:00.769505 26990 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:00.770651 26990 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:00.778869 26990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f98ac757b068473db688174ed15e3a57: Generated new TSK 0
I20260810 03:13:00.779733 26990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:13:00.809135 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:00.801051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60308 (local address 127.18.112.126:38245)
0810 03:13:00.801239 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:00.801245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:00.801710 (+ 465us) server_negotiation.cc:407] Connection header received
0810 03:13:00.801902 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:00.801908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:00.801997 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:00.802154 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:13:00.802561 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.803639 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.804945 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.805637 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.805758 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.806190 (+ 432us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:13:00.808503 (+ 2313us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38193/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 03:13:00.808829 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38193/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 03:13:00.809276 26979 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38193/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 03:13:00.810811 27011 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:00.800996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:38245 (local address 127.0.0.1:60308)
0810 03:13:00.801608 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:00.801623 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:00.801744 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:00.802160 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:00.802163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:00.802171 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:13:00.802428 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:00.802436 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.803750 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.803753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:00.804809 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:00.804821 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:00.805787 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:00.805791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:00.805923 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:00.805952 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:13:00.808714 (+ 2762us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38193/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 03:13:00.810378 (+ 1664us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.112.126:38245: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38193/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":1380,"thread_start_us":340,"threads_started":1}
I20260810 03:13:00.812167 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 26885
I20260810 03:13:00.813380 26969 generic_service.cc:196] Checking for leaks (request via RPC)
E20260810 03:13:00.820724 27013 webserver.cc:533] Webserver: sslize failed:
E20260810 03:13:00.820806 27013 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 03:13:00.903817 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 26885
2026-08-10T03:13:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (711 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T03:13:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:00Z Disabled control of system clock
I20260810 03:13:00.993826 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40545
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:40545
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/testchainca.cert with env {}
W20260810 03:13:01.309247 27021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:01.309538 27021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:01.309630 27021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:01.316505 27021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:01.316607 27021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:01.316653 27021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:01.316709 27021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:01.316751 27021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:13:01.316809 27021 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:13:01.316847 27021 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 03:13:01.326340 27021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:40545
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:01.327462 27021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:01.328735 27021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:01.340227 27026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:01.340266 27030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:01.340188 27032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:01.345147 27021 server_base.cc:1034] running on GCE node
I20260810 03:13:01.345873 27021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:01.347153 27021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:01.348340 27021 hybrid_clock.cc:648] HybridClock initialized: now 1786331581348300 us; error 32 us; skew 500 ppm
I20260810 03:13:01.348637 27021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:01.350678 27021 webserver.cc:460] Webserver started at http://127.18.112.126:43221/ using document root <none> and password file <none>
I20260810 03:13:01.351291 27021 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:01.351378 27021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:01.351646 27021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:01.354333 27021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "f38f65caf4264b3782183302fb3868b5"
format_stamp: "Formatted at 2026-08-10 03:13:01 on dist-test-slave-jlzn"
server_key: "fde4344f3744d5563b0c1131f503363c"
server_key_iv: "0300b37e78a59831cdc7f55dc6a8863d"
server_key_version: "encryptionkey@0"
I20260810 03:13:01.355051 27021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "f38f65caf4264b3782183302fb3868b5"
format_stamp: "Formatted at 2026-08-10 03:13:01 on dist-test-slave-jlzn"
server_key: "fde4344f3744d5563b0c1131f503363c"
server_key_iv: "0300b37e78a59831cdc7f55dc6a8863d"
server_key_version: "encryptionkey@0"
I20260810 03:13:01.359731 27021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260810 03:13:01.362852 27039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:01.364082 27021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260810 03:13:01.364253 27021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "f38f65caf4264b3782183302fb3868b5"
format_stamp: "Formatted at 2026-08-10 03:13:01 on dist-test-slave-jlzn"
server_key: "fde4344f3744d5563b0c1131f503363c"
server_key_iv: "0300b37e78a59831cdc7f55dc6a8863d"
server_key_version: "encryptionkey@0"
I20260810 03:13:01.364439 27021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:01.377017 27021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:01.377687 27021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:01.377924 27021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:01.394129 27021 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:40545
I20260810 03:13:01.394160 27119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:40545 every 8 connection(s)
I20260810 03:13:01.395341 27021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:01.398736 27120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:01.399892 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 27021
I20260810 03:13:01.400082 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:01.400701 18881 external_mini_cluster.cc:1428] Setting key d7ce1e651d6eff7c11263b1bdf291c16
I20260810 03:13:01.411618 27120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5: Bootstrap starting.
I20260810 03:13:01.413268 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:01.402349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46840 (local address 127.18.112.126:40545)
0810 03:13:01.403317 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:01.403327 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:01.403376 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:13:01.404887 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:01.404911 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:01.405335 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:01.405626 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:01.406189 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.407397 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.409230 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.409869 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.409993 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:01.411146 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:01.411155 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:01.411167 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:01.411665 (+ 498us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:01.411746 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:01.411771 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:01.411904 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:01.412102 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 03:13:01.412390 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":363,"threads_started":1}
I20260810 03:13:01.415021 27120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:01.416209 27120 log.cc:824] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:01.416785 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:13:01.419188 27120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5: No bootstrap required, opened a new log
I20260810 03:13:01.426321 27120 raft_consensus.cc:348] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } }
I20260810 03:13:01.426609 27120 raft_consensus.cc:374] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:01.426679 27120 raft_consensus.cc:729] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38f65caf4264b3782183302fb3868b5, State: Initialized, Role: FOLLOWER
I20260810 03:13:01.427096 27120 consensus_queue.cc:260] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } }
I20260810 03:13:01.427304 27120 raft_consensus.cc:388] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:01.427399 27120 raft_consensus.cc:482] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:01.427516 27120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:01.429746 27120 raft_consensus.cc:504] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } }
I20260810 03:13:01.430190 27120 leader_election.cc:302] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f38f65caf4264b3782183302fb3868b5; no voters:
I20260810 03:13:01.430694 27120 leader_election.cc:288] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:01.430828 27133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:01.431460 27133 raft_consensus.cc:686] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [term 1 LEADER]: Becoming Leader. State: Replica: f38f65caf4264b3782183302fb3868b5, State: Running, Role: LEADER
I20260810 03:13:01.432030 27133 consensus_queue.cc:237] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } }
I20260810 03:13:01.432646 27120 sys_catalog.cc:564] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:01.434384 27134 sys_catalog.cc:455] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f38f65caf4264b3782183302fb3868b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } } }
I20260810 03:13:01.434564 27135 sys_catalog.cc:455] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f38f65caf4264b3782183302fb3868b5. Latest consensus state: current_term: 1 leader_uuid: "f38f65caf4264b3782183302fb3868b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f38f65caf4264b3782183302fb3868b5" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40545 } } }
I20260810 03:13:01.434770 27134 sys_catalog.cc:458] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:01.434844 27135 sys_catalog.cc:458] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:01.441181 27143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:01.446091 27143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:01.453580 27143 catalog_manager.cc:1347] Generated new cluster ID: 3132ac5b41604d2eb16293016f3f1193
I20260810 03:13:01.453681 27143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:01.468622 27143 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:01.470310 27143 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:01.482796 27143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f38f65caf4264b3782183302fb3868b5: Generated new TSK 0
I20260810 03:13:01.483865 27143 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:13:01.558466 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:01.496323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46850 (local address 127.18.112.126:40545)
0810 03:13:01.496497 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:01.496504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:01.496806 (+ 302us) server_negotiation.cc:407] Connection header received
0810 03:13:01.496988 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:01.496994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:01.497090 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:01.497259 (+ 169us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:13:01.497632 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.498734 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.500093 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.500777 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.500896 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:01.501306 (+ 410us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:13:01.557762 (+ 56456us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 03:13:01.558133 (+ 371us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46850: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 03:13:01.558620 27125 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46850: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 03:13:01.558748 27167 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:01.496191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40545 (local address 127.0.0.1:46850)
0810 03:13:01.496708 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:01.496726 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:01.496839 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:01.497253 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:01.497256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:01.497265 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:13:01.497494 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:01.497502 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.498857 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.498860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:01.499960 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:01.499972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:01.500912 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:01.500916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:01.501045 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:01.501073 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:13:01.558044 (+ 56971us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 03:13:01.558329 (+ 285us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.112.126:40545: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":267,"threads_started":1}
I20260810 03:13:01.560604 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 27021
I20260810 03:13:01.561740 27111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:01.655336 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 27021
2026-08-10T03:13:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (730 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (400 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (395 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:02 dist-test-slave-jlzn krb5kdc[27190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:02 dist-test-slave-jlzn krb5kdc[27190](info): set up 2 sockets
Aug 10 03:13:02 dist-test-slave-jlzn krb5kdc[27190](info): commencing operation
krb5kdc: starting...
W20260810 03:13:03.623703 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:03 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:13:03.823427 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34069
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:34069
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:04.132800 27206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:04.133064 27206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:04.133157 27206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:04.141984 27206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:04.142191 27206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:04.142306 27206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:04.142417 27206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:04.142504 27206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:04.152830 27206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:34069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:04.154023 27206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:04.155354 27206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:04.167021 27219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:04.167080 27216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:04.167058 27217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:04.167760 27206 server_base.cc:1034] running on GCE node
I20260810 03:13:04.168509 27206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:04.169819 27206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:04.171018 27206 hybrid_clock.cc:648] HybridClock initialized: now 1786331584170974 us; error 28 us; skew 500 ppm
I20260810 03:13:04.171368 27206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:04 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331584, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:04.174223 27206 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:13:04.175558 27206 webserver.cc:460] Webserver started at http://127.18.112.126:40701/ using document root <none> and password file <none>
I20260810 03:13:04.176215 27206 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:04.176331 27206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:04.176625 27206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:04.179368 27206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "e633bf3ee86948f194cea1b1a117441f"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "3db586cfe6d2d7fc4182d1ca222ea3cb"
server_key_iv: "15920d4619d14233a2c0d6e013df3055"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.180142 27206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "e633bf3ee86948f194cea1b1a117441f"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "3db586cfe6d2d7fc4182d1ca222ea3cb"
server_key_iv: "15920d4619d14233a2c0d6e013df3055"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.184967 27206 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:13:04.188437 27230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:04.189584 27206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260810 03:13:04.189752 27206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "e633bf3ee86948f194cea1b1a117441f"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "3db586cfe6d2d7fc4182d1ca222ea3cb"
server_key_iv: "15920d4619d14233a2c0d6e013df3055"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.189924 27206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:04.206669 27206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:04.210079 27206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:04.210316 27206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:04.226738 27206 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:34069
I20260810 03:13:04.226760 27307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:34069 every 8 connection(s)
I20260810 03:13:04.227948 27206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:04.230063 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 27206
I20260810 03:13:04.230314 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:04.231119 18881 external_mini_cluster.cc:1428] Setting key 179face5ccf8fdd66ba8fbe0080489e1
I20260810 03:13:04.231987 27309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 03:13:04 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:04.243688 27309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f: Bootstrap starting.
I20260810 03:13:04.247087 27309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:04.248183 27309 log.cc:824] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:04.251147 27309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f: No bootstrap required, opened a new log
I20260810 03:13:04.251783 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:04.233125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37410 (local address 127.18.112.126:34069)
0810 03:13:04.233828 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:04.233839 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:04.233876 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:13:04.235346 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:04.235367 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:04.235709 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:04.236080 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:04.237417 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.238730 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.239925 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.240588 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.240762 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:04.244899 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:04.244907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:04.244919 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:04.244950 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:04.247951 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:04.248747 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:04.248755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:04.248764 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:04.248981 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:04.249326 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:04.249331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:04.249335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:04.249832 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:04.250034 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:04.250460 (+ 426us) server_negotiation.cc:299] Negotiation successful
0810 03:13:04.250745 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":315,"threads_started":1}
I20260810 03:13:04.258183 27309 raft_consensus.cc:348] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } }
I20260810 03:13:04.258486 27309 raft_consensus.cc:374] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:04.258574 27309 raft_consensus.cc:729] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e633bf3ee86948f194cea1b1a117441f, State: Initialized, Role: FOLLOWER
I20260810 03:13:04.259053 27309 consensus_queue.cc:260] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } }
I20260810 03:13:04.259259 27309 raft_consensus.cc:388] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:04.259390 27309 raft_consensus.cc:482] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:04.259536 27309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:04.261683 27309 raft_consensus.cc:504] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } }
I20260810 03:13:04.262181 27309 leader_election.cc:302] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e633bf3ee86948f194cea1b1a117441f; no voters:
I20260810 03:13:04.262689 27309 leader_election.cc:288] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:04.262801 27319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:04.263411 27319 raft_consensus.cc:686] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [term 1 LEADER]: Becoming Leader. State: Replica: e633bf3ee86948f194cea1b1a117441f, State: Running, Role: LEADER
I20260810 03:13:04.263962 27319 consensus_queue.cc:237] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } }
I20260810 03:13:04.264461 27309 sys_catalog.cc:564] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:04.266458 27321 sys_catalog.cc:455] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e633bf3ee86948f194cea1b1a117441f. Latest consensus state: current_term: 1 leader_uuid: "e633bf3ee86948f194cea1b1a117441f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } } }
I20260810 03:13:04.266849 27321 sys_catalog.cc:458] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:04.266480 27320 sys_catalog.cc:455] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e633bf3ee86948f194cea1b1a117441f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e633bf3ee86948f194cea1b1a117441f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34069 } } }
I20260810 03:13:04.268010 27320 sys_catalog.cc:458] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:04.272950 27325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:04.277727 27325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:04.287010 27325 catalog_manager.cc:1347] Generated new cluster ID: 9bc0ce3c37c54a4cbdb4e61780dd3db5
I20260810 03:13:04.287114 27325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:04.302058 27325 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:04.303200 27325 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:04.326793 27325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e633bf3ee86948f194cea1b1a117441f: Generated new TSK 0
I20260810 03:13:04.327514 27325 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:13:04.388159 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:04.705494 27350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:04.705749 27350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:04.705873 27350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:04.712888 27350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:04.712993 27350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:04.713163 27350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:04.722522 27350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:04.723687 27350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:04.724939 27350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:04.737123 27359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:04.737097 27358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:04.737821 27362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:04.738157 27350 server_base.cc:1034] running on GCE node
I20260810 03:13:04.738740 27350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:04.739562 27350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:04.740759 27350 hybrid_clock.cc:648] HybridClock initialized: now 1786331584740705 us; error 43 us; skew 500 ppm
I20260810 03:13:04.741044 27350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:04 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331584, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:04.743994 27350 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:13:04.745289 27350 webserver.cc:460] Webserver started at http://127.18.112.65:42539/ using document root <none> and password file <none>
I20260810 03:13:04.745913 27350 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:04.746033 27350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:04.746315 27350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:04.749089 27350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "ea6fc395ac934563be756521dd6de74b"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "7905f1fdaffe027405aa16ecf6dd3476"
server_key_iv: "2c5479ec6ccaffe146760e78d3c5ec63"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.749838 27350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "ea6fc395ac934563be756521dd6de74b"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "7905f1fdaffe027405aa16ecf6dd3476"
server_key_iv: "2c5479ec6ccaffe146760e78d3c5ec63"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.754596 27350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:13:04.757769 27369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:04.758947 27350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:04.759094 27350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "ea6fc395ac934563be756521dd6de74b"
format_stamp: "Formatted at 2026-08-10 03:13:04 on dist-test-slave-jlzn"
server_key: "7905f1fdaffe027405aa16ecf6dd3476"
server_key_iv: "2c5479ec6ccaffe146760e78d3c5ec63"
server_key_version: "encryptionkey@0"
I20260810 03:13:04.759272 27350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:04.773576 27350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:04.777153 27350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:04.777398 27350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:04.778245 27350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:04.779438 27350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:04.779522 27350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:04.779641 27350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:04.779698 27350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:04.809350 27350 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:42525
I20260810 03:13:04.809389 27547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:42525 every 8 connection(s)
I20260810 03:13:04.810524 27350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:04.818069 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 27350
I20260810 03:13:04.818272 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:04.818889 18881 external_mini_cluster.cc:1428] Setting key 532fdbd785d4285e2f803cc6dcf71e5c
Aug 10 03:13:04 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331584, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:04.829581 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:04.812894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:48979 (local address 127.18.112.126:34069)
0810 03:13:04.813316 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:04.813321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:04.814231 (+ 910us) server_negotiation.cc:407] Connection header received
0810 03:13:04.815915 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:04.815920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:04.815990 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:04.816078 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:04.817417 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.818143 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.819862 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.820296 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.820406 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:04.823793 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:04.823798 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:04.823823 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:04.823862 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:04.826265 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:04.827098 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:04.827103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:04.827105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:04.827233 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:04.827670 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:04.827673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:04.827675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:04.828091 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:04.828221 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:04.828993 (+ 772us) server_negotiation.cc:299] Negotiation successful
0810 03:13:04.829224 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":213,"threads_started":1}
I20260810 03:13:04.830252 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:04.813403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34069 (local address 127.18.112.65:48979)
0810 03:13:04.814076 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:04.814118 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:04.815652 (+ 1534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:04.816262 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:04.816270 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:04.816754 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:04.817270 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:04.817286 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.818300 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.818304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:04.819702 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:04.819714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:04.820510 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:04.820518 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:04.820747 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:04.821337 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:04.821359 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:04.823583 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:04.826404 (+ 2821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:04.826412 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:04.826425 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:04.826963 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:04.827335 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:04.827339 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:04.827343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:04.827571 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:04.828220 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:04.828226 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:04.828601 (+ 375us) client_negotiation.cc:769] Sending connection context
0810 03:13:04.828877 (+ 276us) client_negotiation.cc:240] Negotiation successful
0810 03:13:04.829237 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":261,"threads_started":1}
I20260810 03:13:04.831614 27548 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34069
I20260810 03:13:04.831967 27548 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:04.832803 27548 heartbeater.cc:511] Master 127.18.112.126:34069 requested a full tablet report, sending...
I20260810 03:13:04.834870 27256 ts_manager.cc:194] Registered new tserver with Master: ea6fc395ac934563be756521dd6de74b (127.18.112.65:42525)
I20260810 03:13:04.836292 27256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:48979
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:13:04.866464 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:05.177012 27555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:05.177271 27555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:05.177366 27555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:05.184170 27555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:05.184264 27555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:05.184376 27555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:05.193735 27555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:05.194903 27555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:05.196130 27555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:05.208698 27565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:05.208801 27563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:05.208781 27562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:05.209703 27555 server_base.cc:1034] running on GCE node
I20260810 03:13:05.210230 27555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:05.211038 27555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:05.212231 27555 hybrid_clock.cc:648] HybridClock initialized: now 1786331585212188 us; error 37 us; skew 500 ppm
I20260810 03:13:05.212514 27555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.215420 27555 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:13:05.216753 27555 webserver.cc:460] Webserver started at http://127.18.112.66:36727/ using document root <none> and password file <none>
I20260810 03:13:05.217387 27555 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:05.217499 27555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:05.217784 27555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:05.220643 27555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "e4d6e38013af4ef38f1eb1755c99ddaa"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "fb108e0d00c251ee6a9931bfe5d354ab"
server_key_iv: "c64cab599206775f1fd56a8fc727fa7d"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.221378 27555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "e4d6e38013af4ef38f1eb1755c99ddaa"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "fb108e0d00c251ee6a9931bfe5d354ab"
server_key_iv: "c64cab599206775f1fd56a8fc727fa7d"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.226248 27555 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:13:05.230284 27575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.231706 27555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:13:05.231925 27555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "e4d6e38013af4ef38f1eb1755c99ddaa"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "fb108e0d00c251ee6a9931bfe5d354ab"
server_key_iv: "c64cab599206775f1fd56a8fc727fa7d"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.232148 27555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:05.260905 27555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:05.264580 27555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:05.264853 27555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:05.265681 27555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:05.266852 27555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:05.266925 27555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.267019 27555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:05.267063 27555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.296299 27555 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:33873
I20260810 03:13:05.296360 27746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:33873 every 8 connection(s)
I20260810 03:13:05.297482 27555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:05.303161 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 27555
I20260810 03:13:05.303376 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:05.303936 18881 external_mini_cluster.cc:1428] Setting key d13aa4272ae87bc440b31b95cff97e81
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:05.317237 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.299678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:41303 (local address 127.18.112.126:34069)
0810 03:13:05.299919 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.299925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.301063 (+ 1138us) server_negotiation.cc:407] Connection header received
0810 03:13:05.302743 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.302748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.302817 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.302900 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.304787 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.305548 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.307649 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.308108 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.308204 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.311887 (+ 3683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.311892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.311895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.311926 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.314445 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.315096 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.315101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.315104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.315258 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.315613 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.315618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.315621 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.315979 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.316124 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.316702 (+ 578us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.316922 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 03:13:05.317907 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.300211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34069 (local address 127.18.112.66:41303)
0810 03:13:05.300905 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:05.300940 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:05.302508 (+ 1568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:05.303157 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:05.303168 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:05.303885 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:05.304613 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:05.304633 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.305692 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.305696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:05.307493 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:05.307514 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.308310 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.308317 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:05.308561 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.309206 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:05.309233 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:05.311669 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:05.314585 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:05.314591 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:05.314602 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:05.314989 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:05.315349 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:05.315352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:05.315354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:05.315516 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:05.316090 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:05.316095 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:05.316366 (+ 271us) client_negotiation.cc:769] Sending connection context
0810 03:13:05.316576 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 03:13:05.316923 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":272,"threads_started":1}
I20260810 03:13:05.319129 27749 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34069
I20260810 03:13:05.319446 27749 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:05.320254 27749 heartbeater.cc:511] Master 127.18.112.126:34069 requested a full tablet report, sending...
I20260810 03:13:05.321782 27256 ts_manager.cc:194] Registered new tserver with Master: e4d6e38013af4ef38f1eb1755c99ddaa (127.18.112.66:33873)
I20260810 03:13:05.322530 27256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:41303
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:13:05.354214 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:05.666507 27755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:05.666770 27755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:05.666896 27755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:05.673867 27755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:05.673959 27755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:05.674109 27755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:05.683176 27755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:05.684280 27755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:05.685456 27755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:05.698246 27761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:05.698196 27763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:05.698233 27765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:05.699007 27755 server_base.cc:1034] running on GCE node
I20260810 03:13:05.699586 27755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:05.700507 27755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:05.701709 27755 hybrid_clock.cc:648] HybridClock initialized: now 1786331585701667 us; error 28 us; skew 500 ppm
I20260810 03:13:05.701992 27755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.708624 27755 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:13:05.709939 27755 webserver.cc:460] Webserver started at http://127.18.112.67:43077/ using document root <none> and password file <none>
I20260810 03:13:05.710580 27755 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:05.710707 27755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:05.710989 27755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:05.713822 27755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "2028b1b69bb44af7a5787df9e16d568a"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "550561cf70049280ef7a6e4ed50129b9"
server_key_iv: "8dea1868379f429189db2fb24bcd779f"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.714573 27755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "2028b1b69bb44af7a5787df9e16d568a"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "550561cf70049280ef7a6e4ed50129b9"
server_key_iv: "8dea1868379f429189db2fb24bcd779f"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.719303 27755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 03:13:05.722694 27774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.723891 27755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:05.724040 27755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "2028b1b69bb44af7a5787df9e16d568a"
format_stamp: "Formatted at 2026-08-10 03:13:05 on dist-test-slave-jlzn"
server_key: "550561cf70049280ef7a6e4ed50129b9"
server_key_iv: "8dea1868379f429189db2fb24bcd779f"
server_key_version: "encryptionkey@0"
I20260810 03:13:05.724215 27755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:05.753960 27755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:05.757660 27755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:05.757972 27755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:05.758886 27755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:05.760176 27755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:05.760258 27755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.760380 27755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:05.760440 27755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:05.790258 27755 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:42173
I20260810 03:13:05.790320 27935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:42173 every 8 connection(s)
I20260810 03:13:05.791471 27755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:05.801676 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 27755
I20260810 03:13:05.801880 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:05.802325 18881 external_mini_cluster.cc:1428] Setting key 7f2f4be55a2eb8aac5504464ff2b0393
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:05.810846 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.793921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:48247 (local address 127.18.112.126:34069)
0810 03:13:05.794089 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.794093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.795334 (+ 1241us) server_negotiation.cc:407] Connection header received
0810 03:13:05.797125 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.797132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.797212 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.797299 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.798786 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.799573 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.801111 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.801657 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.801802 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.805705 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.805710 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.805713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.805745 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.808016 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.808706 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.808710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.808712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.808833 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.809256 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.809259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.809261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.809531 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.809671 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.810291 (+ 620us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.810505 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:13:05.811712 27940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.794504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34069 (local address 127.18.112.67:48247)
0810 03:13:05.795182 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:05.795225 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:05.796874 (+ 1649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:05.797537 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:05.797545 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:05.798024 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:05.798607 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:05.798625 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.799725 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.799729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:05.800976 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:05.800988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.801901 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.801907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:05.802159 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.802804 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:05.802826 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:05.805510 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:05.808140 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:05.808149 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:05.808188 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:05.808580 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:05.808937 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:05.808942 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:05.808947 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:05.809137 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:05.809655 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:05.809662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:05.809956 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 03:13:05.810183 (+ 227us) client_negotiation.cc:240] Negotiation successful
0810 03:13:05.810648 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":272,"threads_started":1}
I20260810 03:13:05.812961 27937 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34069
I20260810 03:13:05.813277 27937 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:05.814033 27937 heartbeater.cc:511] Master 127.18.112.126:34069 requested a full tablet report, sending...
I20260810 03:13:05.815308 27256 ts_manager.cc:194] Registered new tserver with Master: 2028b1b69bb44af7a5787df9e16d568a (127.18.112.67:42173)
I20260810 03:13:05.816180 27256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:48247
I20260810 03:13:05.817603 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:13:05.839502 27548 heartbeater.cc:503] Master 127.18.112.126:34069 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/test-admin.keytab.
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.846141 18881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 03:13:05.850795 27951 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:05.848519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.18.112.65:42525)
0810 03:13:05.849269 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.849276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.849302 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:05.849355 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.849362 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.849554 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.849688 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.850433 (+ 745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34498: BlockingRecv error: recv got EOF from 127.0.0.1:34498 (error 108)
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":464,"threads_started":1}
W20260810 03:13:05.851080 18881 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc)
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.852567 18881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.853834 18881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:13:05.867565 27951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.855330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.18.112.65:42525)
0810 03:13:05.855512 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.855517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.855604 (+ 87us) server_negotiation.cc:407] Connection header received
0810 03:13:05.855731 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.855734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.855787 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.855892 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.856828 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.857765 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.858901 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.859432 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.859518 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.862654 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.862664 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.862677 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.862713 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.865444 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.866004 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.866010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.866012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.866133 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.866398 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.866400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.866402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.866745 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.866951 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.867152 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.867333 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 03:13:05.872386 27951 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:05.871071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.18.112.65:42525)
0810 03:13:05.871259 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.871264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.871361 (+ 97us) server_negotiation.cc:407] Connection header received
0810 03:13:05.871473 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.871477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.871548 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.871613 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.872217 (+ 604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34514: BlockingRecv error: recv got EOF from 127.0.0.1:34514 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 03:13:05.872545 18881 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc' of type FILE
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.873960 18881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.875149 18881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:13:05.886771 27951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.876250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34520 (local address 127.18.112.65:42525)
0810 03:13:05.876414 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.876419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.876646 (+ 227us) server_negotiation.cc:407] Connection header received
0810 03:13:05.876763 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.876766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.876813 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.876871 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.877657 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.878296 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.879339 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.879729 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.879840 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.882743 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.882747 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.882750 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.882790 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.884903 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.885435 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.885438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.885440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.885540 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.885808 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.885811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.885813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.886032 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.886209 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.886377 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.886511 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 03:13:05.890478 27951 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:05.888959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34528 (local address 127.18.112.65:42525)
0810 03:13:05.889117 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.889122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.889302 (+ 180us) server_negotiation.cc:407] Connection header received
0810 03:13:05.889439 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.889444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.889509 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.889582 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.890279 (+ 697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34528: BlockingRecv error: recv got EOF from 127.0.0.1:34528 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 03:13:05.890640 18881 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786331536832683-18881-0/krb5kdc/krb5cc' of type FILE
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.891983 18881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:05.893186 18881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:13:05 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:13:05.905148 27951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.894262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34536 (local address 127.18.112.65:42525)
0810 03:13:05.894441 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.894446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.894636 (+ 190us) server_negotiation.cc:407] Connection header received
0810 03:13:05.894746 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.894749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.894796 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.894860 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.895620 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.896400 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.897571 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.897959 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.898043 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.901023 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.901027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.901030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.901057 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.903147 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.903658 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.903661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.903663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.903823 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.904104 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.904107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.904109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.904365 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.904571 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.904712 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.904856 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:13:05.906400 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 27350
I20260810 03:13:05.916234 27951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:05.906968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34548 (local address 127.18.112.65:42525)
0810 03:13:05.907132 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:05.907137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:05.907358 (+ 221us) server_negotiation.cc:407] Connection header received
0810 03:13:05.907452 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:05.907455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:05.907502 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:05.907566 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:05.908410 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.909013 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.910072 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:05.910484 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:05.910568 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:05.912298 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:05.912302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:05.912305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:05.912327 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:05.914314 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.914826 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.914829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.914831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.914944 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:05.915189 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:05.915191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:05.915193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:05.915394 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:05.915567 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:05.915776 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 03:13:05.915946 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:13:05.916709 27539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:05.997797 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 27350
I20260810 03:13:06.019354 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 27555
Aug 10 03:13:06 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:13:06.033363 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:06.020267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56070 (local address 127.18.112.66:33873)
0810 03:13:06.020736 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:06.020743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:06.020769 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:06.020831 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:06.020837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:06.021037 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:06.021168 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:06.022085 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:06.023041 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:06.024254 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:06.024769 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:06.024859 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:06.028421 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:06.028430 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:06.028461 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:06.028498 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:06.030961 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:06.031506 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:06.031512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:06.031514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:06.031634 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:06.032067 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:06.032070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:06.032072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:06.032398 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:06.032626 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:06.032874 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 03:13:06.033065 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":223,"threads_started":1}
I20260810 03:13:06.034544 27736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:06.114115 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 27555
I20260810 03:13:06.132171 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 27755
Aug 10 03:13:06 dist-test-slave-jlzn krb5kdc[27190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:13:06.146703 27972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:06.133024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39810 (local address 127.18.112.67:42173)
0810 03:13:06.133617 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:06.133624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:06.133664 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:13:06.133725 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:06.133732 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:06.133935 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:06.134060 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:06.134952 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:06.136171 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:06.137391 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:06.137934 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:06.138033 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:06.141846 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:06.141857 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:06.141872 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:06.141905 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:06.144480 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:06.145080 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:06.145086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:06.145088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:06.145205 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:06.145477 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:06.145480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:06.145482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:06.145804 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:06.146054 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:06.146222 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:13:06.146411 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":280,"threads_started":1}
I20260810 03:13:06.147980 27929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:06.229552 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 27755
I20260810 03:13:06.252318 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 27206
I20260810 03:13:06.253402 27302 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:06.353302 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 27206
2026-08-10T03:13:06Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3906 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:06 dist-test-slave-jlzn krb5kdc[27979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:06 dist-test-slave-jlzn krb5kdc[27979](info): set up 2 sockets
Aug 10 03:13:06 dist-test-slave-jlzn krb5kdc[27979](info): commencing operation
krb5kdc: starting...
W20260810 03:13:07.534233 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:07 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab.
Entry for principal oryx/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab.
I20260810 03:13:07.737308 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33079
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab
--principal=oryx/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:08.046981 28000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:08.047250 28000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:08.047379 28000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:08.054273 28000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:08.054365 28000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:08.054440 28000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:08.054510 28000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:08.054567 28000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:08.063722 28000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab
--principal=oryx/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:08.064875 28000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:08.066146 28000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:08.077003 28006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:08.077039 28008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:08.077064 28011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:08.077843 28000 server_base.cc:1034] running on GCE node
I20260810 03:13:08.078585 28000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:08.079862 28000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:08.081067 28000 hybrid_clock.cc:648] HybridClock initialized: now 1786331588081016 us; error 39 us; skew 500 ppm
I20260810 03:13:08.081383 28000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:08 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331588, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:08.084334 28000 init.cc:377] Logged in from keytab as oryx/127.18.112.126@KRBTEST.COM (short username oryx)
I20260810 03:13:08.085628 28000 webserver.cc:460] Webserver started at http://127.18.112.126:38783/ using document root <none> and password file <none>
I20260810 03:13:08.086259 28000 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:08.086376 28000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:08.086652 28000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:08.089672 28000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "62cd9d90c58d4f69b807c5b387c8c19f"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "1fcc5bae46159ae649e50614cec7413e"
server_key_iv: "82ae83389965f1e5d8f8c59bf7831260"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.090440 28000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "62cd9d90c58d4f69b807c5b387c8c19f"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "1fcc5bae46159ae649e50614cec7413e"
server_key_iv: "82ae83389965f1e5d8f8c59bf7831260"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.095329 28000 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 03:13:08.098531 28027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:08.099727 28000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:08.099929 28000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "62cd9d90c58d4f69b807c5b387c8c19f"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "1fcc5bae46159ae649e50614cec7413e"
server_key_iv: "82ae83389965f1e5d8f8c59bf7831260"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.100116 28000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:08.120158 28000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:08.123909 28000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:08.124156 28000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:08.140525 28000 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:33079
I20260810 03:13:08.140558 28113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:33079 every 8 connection(s)
I20260810 03:13:08.141793 28000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:08.144327 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28000
I20260810 03:13:08.144531 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:08.145190 18881 external_mini_cluster.cc:1428] Setting key 35e671846c3fb0cc63cf2c3ee4ed6b14
I20260810 03:13:08.145396 28114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:08.158985 28114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Bootstrap starting.
Aug 10 03:13:08 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:08.162664 28114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:08.163967 28114 log.cc:824] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:08.166564 28114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: No bootstrap required, opened a new log
I20260810 03:13:08.167941 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:08.147026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48392 (local address 127.18.112.126:33079)
0810 03:13:08.147883 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:08.147898 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:08.147945 (+ 47us) server_negotiation.cc:407] Connection header received
0810 03:13:08.150005 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:08.150033 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:08.150518 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:08.150937 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:08.152242 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.154207 (+ 1965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.155356 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.156427 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.156610 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:08.160501 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:08.160513 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:08.160535 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:08.160581 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:08.164242 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:08.164855 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:08.164861 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:08.164867 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:08.165046 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:08.165393 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:08.165397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:08.165399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:08.165890 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:08.166187 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:08.166610 (+ 423us) server_negotiation.cc:299] Negotiation successful
0810 03:13:08.166987 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":331,"threads_started":1}
I20260810 03:13:08.174726 28114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } }
I20260810 03:13:08.175048 28114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:08.175141 28114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62cd9d90c58d4f69b807c5b387c8c19f, State: Initialized, Role: FOLLOWER
I20260810 03:13:08.175632 28114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } }
I20260810 03:13:08.175896 28114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:08.176023 28114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:08.176177 28114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:08.178319 28114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } }
I20260810 03:13:08.178771 28114 leader_election.cc:302] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62cd9d90c58d4f69b807c5b387c8c19f; no voters:
I20260810 03:13:08.179283 28114 leader_election.cc:288] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:08.179392 28122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:08.180029 28122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 LEADER]: Becoming Leader. State: Replica: 62cd9d90c58d4f69b807c5b387c8c19f, State: Running, Role: LEADER
I20260810 03:13:08.180578 28122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } }
I20260810 03:13:08.181183 28114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:08.183247 28123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } }
I20260810 03:13:08.183689 28123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:08.183416 28124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62cd9d90c58d4f69b807c5b387c8c19f. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } }
I20260810 03:13:08.190321 28124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:08.191457 28139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:08.196985 28139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:08.205519 28139 catalog_manager.cc:1347] Generated new cluster ID: b3f0eeeb65fc4075bd93f7c37a77081a
I20260810 03:13:08.205627 28139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:08.233711 28139 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:08.234966 28139 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:08.245851 28139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Generated new TSK 0
I20260810 03:13:08.246567 28139 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
I20260810 03:13:08.305037 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:08.618639 28166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:08.618892 28166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:08.619021 28166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:08.626015 28166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:08.626113 28166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:08.626258 28166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:08.635591 28166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:08.636754 28166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:08.638024 28166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:08.650522 28175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:08.650487 28181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:08.650549 28178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:08.651186 28166 server_base.cc:1034] running on GCE node
I20260810 03:13:08.651755 28166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:08.652658 28166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:08.653852 28166 hybrid_clock.cc:648] HybridClock initialized: now 1786331588653798 us; error 51 us; skew 500 ppm
I20260810 03:13:08.654125 28166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:08 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331588, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:08.657131 28166 init.cc:377] Logged in from keytab as oryx/127.18.112.65@KRBTEST.COM (short username oryx)
I20260810 03:13:08.658365 28166 webserver.cc:460] Webserver started at http://127.18.112.65:38107/ using document root <none> and password file <none>
I20260810 03:13:08.658948 28166 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:08.659045 28166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:08.659277 28166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:08.661972 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "a8a9a2c992664c778eb5515a7184efe2"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "ad5c01222613b62b1cd614595f1a68d2"
server_key_iv: "ca136539e0299c8a9eca928b9a2387c0"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.662688 28166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "a8a9a2c992664c778eb5515a7184efe2"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "ad5c01222613b62b1cd614595f1a68d2"
server_key_iv: "ca136539e0299c8a9eca928b9a2387c0"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.667655 28166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 03:13:08.670763 28189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:08.671985 28166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:08.672128 28166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "a8a9a2c992664c778eb5515a7184efe2"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "ad5c01222613b62b1cd614595f1a68d2"
server_key_iv: "ca136539e0299c8a9eca928b9a2387c0"
server_key_version: "encryptionkey@0"
I20260810 03:13:08.672308 28166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:08.685801 28166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:08.689231 28166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:08.689468 28166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:08.690301 28166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:08.691699 28166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:08.691818 28166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:08.691931 28166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:08.691982 28166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:08.719831 28166 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:38421
I20260810 03:13:08.719905 28355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:38421 every 8 connection(s)
I20260810 03:13:08.721020 28166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:08.722556 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28166
I20260810 03:13:08.722755 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:08.723582 18881 external_mini_cluster.cc:1428] Setting key 87762b080c399c0136fc3e73753042f8
Aug 10 03:13:08 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331588, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:08.740710 28358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:08.723555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:46135 (local address 127.18.112.126:33079)
0810 03:13:08.724157 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:08.724162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:08.725194 (+ 1032us) server_negotiation.cc:407] Connection header received
0810 03:13:08.727120 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:08.727125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:08.727205 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:08.727308 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:08.728797 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.729742 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.731321 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.731891 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.732011 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:08.735458 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:08.735463 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:08.735466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:08.735499 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:08.737899 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:08.738562 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:08.738567 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:08.738569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:08.738679 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:08.739067 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:08.739072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:08.739075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:08.739333 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:08.739462 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:08.740130 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 03:13:08.740340 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":385,"threads_started":1}
I20260810 03:13:08.741585 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:08.724208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:46135)
0810 03:13:08.725016 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:08.725078 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:08.726852 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:08.727523 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:08.727531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:08.728078 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:08.728635 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:08.728652 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.729911 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.729915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:08.731179 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:08.731191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:08.732101 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:08.732106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:08.732323 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:08.732967 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:08.732990 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:08.735260 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:08.738032 (+ 2772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:08.738041 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:08.738055 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:08.738445 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:08.738779 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:08.738784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:08.738788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:08.738960 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:08.739454 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:08.739461 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:08.739768 (+ 307us) client_negotiation.cc:769] Sending connection context
0810 03:13:08.740041 (+ 273us) client_negotiation.cc:240] Negotiation successful
0810 03:13:08.740528 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":308,"threads_started":1}
I20260810 03:13:08.743280 28356 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:08.743549 28356 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:08.744290 28356 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:08.746608 28054 ts_manager.cc:194] Registered new tserver with Master: a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
WARNING: no policy specified for oryx/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:13:08.748323 28054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:46135
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
I20260810 03:13:08.772091 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:09.080777 28363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:09.081048 28363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:09.081183 28363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:09.088332 28363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:09.088440 28363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:09.088579 28363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:09.097882 28363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:09.099063 28363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:09.100346 28363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:09.112764 28371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:09.112731 28375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:09.112677 28372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:09.113669 28363 server_base.cc:1034] running on GCE node
I20260810 03:13:09.114241 28363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:09.115049 28363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:09.116231 28363 hybrid_clock.cc:648] HybridClock initialized: now 1786331589116175 us; error 48 us; skew 500 ppm
I20260810 03:13:09.116518 28363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:09 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331589, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:09.119493 28363 init.cc:377] Logged in from keytab as oryx/127.18.112.66@KRBTEST.COM (short username oryx)
I20260810 03:13:09.120949 28363 webserver.cc:460] Webserver started at http://127.18.112.66:37191/ using document root <none> and password file <none>
I20260810 03:13:09.121596 28363 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:09.121743 28363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:09.122031 28363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:09.124905 28363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "3cb3949f331847e1bdde6cffaf7cc115"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "2ec04d95d495833f5433e9d9312d8f2c"
server_key_iv: "77d9d36426c868d6deb2186773dac7cb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.125658 28363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "3cb3949f331847e1bdde6cffaf7cc115"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "2ec04d95d495833f5433e9d9312d8f2c"
server_key_iv: "77d9d36426c868d6deb2186773dac7cb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.130398 28363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:13:09.133617 28385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.134817 28363 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:09.134966 28363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "3cb3949f331847e1bdde6cffaf7cc115"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "2ec04d95d495833f5433e9d9312d8f2c"
server_key_iv: "77d9d36426c868d6deb2186773dac7cb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.135141 28363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:09.159914 28363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:09.163926 28363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:09.164186 28363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:09.165062 28363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:09.166298 28363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:09.166375 28363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.166495 28363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:09.166555 28363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.197317 28363 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:34541
I20260810 03:13:09.197365 28564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:34541 every 8 connection(s)
I20260810 03:13:09.198540 28363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:09.208282 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28363
I20260810 03:13:09.208463 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:09.208871 18881 external_mini_cluster.cc:1428] Setting key 04ea67bffebfa9157e19c3f31b07a506
Aug 10 03:13:09 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331589, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:09.216872 28358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:09.200896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57279 (local address 127.18.112.126:33079)
0810 03:13:09.201076 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:09.201081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:09.202192 (+ 1111us) server_negotiation.cc:407] Connection header received
0810 03:13:09.204026 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:09.204032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:09.204110 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:09.204195 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:09.205615 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.206350 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.207816 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.208209 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.208319 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:09.211701 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:09.211706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:09.211709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:09.211738 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:09.214109 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:09.214761 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:09.214765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:09.214767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:09.214894 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:09.215285 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:09.215290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:09.215293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:09.215532 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:09.215675 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:09.216336 (+ 661us) server_negotiation.cc:299] Negotiation successful
0810 03:13:09.216566 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:13:09.217702 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:09.201374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:57279)
0810 03:13:09.202036 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:09.202078 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:09.203749 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:09.204424 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:09.204432 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:09.204929 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:09.205458 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:09.205474 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.206490 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.206494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:09.207668 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:09.207680 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.208435 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.208443 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:09.208667 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:09.209285 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:09.209312 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:09.211509 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:09.214240 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:09.214248 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:09.214262 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:09.214653 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:09.214996 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:09.215001 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:09.215005 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:09.215182 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:09.215661 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:09.215668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:09.215997 (+ 329us) client_negotiation.cc:769] Sending connection context
0810 03:13:09.216222 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 03:13:09.216686 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":258,"threads_started":1}
I20260810 03:13:09.218909 28565 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:09.219173 28565 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:09.219861 28565 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:09.221165 28054 ts_manager.cc:194] Registered new tserver with Master: 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541)
I20260810 03:13:09.221931 28054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:57279
WARNING: no policy specified for oryx/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
I20260810 03:13:09.254431 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:09.564348 28571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:09.564601 28571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:09.564699 28571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:09.571656 28571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:09.571748 28571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:09.571892 28571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:09.581192 28571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33079
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:09.582381 28571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:09.583636 28571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:09.596100 28582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:09.596060 28579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:09.596217 28578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:09.596858 28571 server_base.cc:1034] running on GCE node
I20260810 03:13:09.597409 28571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:09.598238 28571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:09.599426 28571 hybrid_clock.cc:648] HybridClock initialized: now 1786331589599381 us; error 35 us; skew 500 ppm
I20260810 03:13:09.599709 28571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:09 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331589, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:09.602638 28571 init.cc:377] Logged in from keytab as oryx/127.18.112.67@KRBTEST.COM (short username oryx)
I20260810 03:13:09.604028 28571 webserver.cc:460] Webserver started at http://127.18.112.67:40113/ using document root <none> and password file <none>
I20260810 03:13:09.604673 28571 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:09.604789 28571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:09.605059 28571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:09.607741 28571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "b6dcd17650d74dab94717ff1c4564d59"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "96d7df5334f35bcf4dae396827e88493"
server_key_iv: "14d881a5f7d14f681906e84f1211fcfb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.608508 28571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "b6dcd17650d74dab94717ff1c4564d59"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "96d7df5334f35bcf4dae396827e88493"
server_key_iv: "14d881a5f7d14f681906e84f1211fcfb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.613256 28571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:13:09.616379 28594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.617538 28571 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:09.617699 28571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "b6dcd17650d74dab94717ff1c4564d59"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "96d7df5334f35bcf4dae396827e88493"
server_key_iv: "14d881a5f7d14f681906e84f1211fcfb"
server_key_version: "encryptionkey@0"
I20260810 03:13:09.617869 28571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:09.644550 28571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:09.648487 28571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:09.648757 28571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:09.649607 28571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:09.650862 28571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:09.650939 28571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.651062 28571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:09.651115 28571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:09.680538 28571 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:35899
I20260810 03:13:09.680583 28764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:35899 every 8 connection(s)
I20260810 03:13:09.681777 28571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:09.692083 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28571
I20260810 03:13:09.692292 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:09.692839 18881 external_mini_cluster.cc:1428] Setting key bcfdf5791ed971e5678413420dc2aeb9
Aug 10 03:13:09 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331589, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:09.706082 28358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:09.684027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:45541 (local address 127.18.112.126:33079)
0810 03:13:09.684782 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:09.684789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:09.685644 (+ 855us) server_negotiation.cc:407] Connection header received
0810 03:13:09.688119 (+ 2475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:09.688124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:09.688225 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:09.688333 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:09.690237 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.691335 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.693724 (+ 2389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.694431 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.694554 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:09.698823 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:09.698830 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:09.698836 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:09.698874 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:09.702655 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:09.703602 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:09.703608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:09.703612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:09.703842 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:09.704338 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:09.704344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:09.704348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:09.704711 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:09.704852 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:09.705512 (+ 660us) server_negotiation.cc:299] Negotiation successful
0810 03:13:09.705753 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588}
I20260810 03:13:09.707181 28771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:09.684630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:45541)
0810 03:13:09.685469 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:09.685514 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:09.687771 (+ 2257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:09.688584 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:09.688596 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:09.689302 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:09.690039 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:09.690064 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.691507 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.691512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:09.693543 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:09.693558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:09.694662 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:09.694671 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:09.694966 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:09.695676 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:09.695706 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:09.698580 (+ 2874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:09.702813 (+ 4233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:09.702821 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:09.702836 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:09.703467 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:09.703952 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:09.703957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:09.703961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:09.704212 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:09.704841 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:09.704863 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:09.705176 (+ 313us) client_negotiation.cc:769] Sending connection context
0810 03:13:09.705393 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 03:13:09.705872 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":312,"threads_started":1}
I20260810 03:13:09.710006 28765 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:09.710384 28765 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:09.711400 28765 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:09.713023 28054 ts_manager.cc:194] Registered new tserver with Master: b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
I20260810 03:13:09.714139 28054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:45541
I20260810 03:13:09.721230 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.112.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.125@KRBTEST.COM" created.
I20260810 03:13:09.751075 28356 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.125.keytab.
Entry for principal oryx/127.18.112.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.125.keytab.
I20260810 03:13:09.771149 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:35539
--webserver_interface=127.18.112.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.125.keytab
--principal=oryx/127.18.112.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33079,127.18.112.125:35539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:10.089270 28776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:10.089555 28776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:10.089686 28776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:10.096900 28776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:10.097002 28776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:10.097080 28776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:10.097157 28776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:10.097218 28776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:10.107404 28776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33079,127.18.112.125:35539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.125.keytab
--principal=oryx/127.18.112.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:35539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.112.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
W20260810 03:13:10.107735 28776 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.18.112.126:33079,127.18.112.125:35539'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 03:13:10.108935 28776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:10.110262 28776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:10.121500 28787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.121623 28784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.121582 28785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:10.122339 28776 server_base.cc:1034] running on GCE node
I20260810 03:13:10.123061 28776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:10.124420 28776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:10.125643 28776 hybrid_clock.cc:648] HybridClock initialized: now 1786331590125572 us; error 35 us; skew 500 ppm
I20260810 03:13:10.125926 28776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:10.128878 28776 init.cc:377] Logged in from keytab as oryx/127.18.112.125@KRBTEST.COM (short username oryx)
I20260810 03:13:10.130259 28776 webserver.cc:460] Webserver started at http://127.18.112.125:34661/ using document root <none> and password file <none>
I20260810 03:13:10.130897 28776 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:10.130999 28776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:10.131292 28776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:10.134140 28776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/instance:
uuid: "d6b1c90f841d45e8a98f3c46dd152448"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "9dba2ed911df28f7000106160fa68064"
server_key_iv: "3b73f39df84ee56c7d00c8e6993d6336"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.134886 28776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal/instance:
uuid: "d6b1c90f841d45e8a98f3c46dd152448"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "9dba2ed911df28f7000106160fa68064"
server_key_iv: "3b73f39df84ee56c7d00c8e6993d6336"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.139858 28776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260810 03:13:10.143213 28800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:10.144542 28776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:13:10.144707 28776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "d6b1c90f841d45e8a98f3c46dd152448"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "9dba2ed911df28f7000106160fa68064"
server_key_iv: "3b73f39df84ee56c7d00c8e6993d6336"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.144905 28776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:10.168506 28776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:10.172538 28776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:10.172786 28776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:10.190217 28776 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.125:35539
I20260810 03:13:10.190250 28876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.125:35539 every 8 connection(s)
I20260810 03:13:10.191426 28776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
I20260810 03:13:10.195389 28877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:10.199445 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28776
I20260810 03:13:10.204190 28877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.125@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:10.223855 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.207936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48400 (local address 127.18.112.126:33079)
0810 03:13:10.210374 (+ 2438us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.210379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.210393 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:13:10.210438 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.210441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.210495 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.210584 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.211794 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.212817 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.214106 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.214720 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.214847 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.218118 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.218125 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.218130 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.218181 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.221104 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.221814 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.221818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.221821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.221945 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.222348 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.222353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.222357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.222717 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.222846 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.223280 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.223483 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2323,"thread_start_us":2229,"threads_started":1}
I20260810 03:13:10.223928 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.201801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55354 (local address 127.18.112.125:35539)
0810 03:13:10.203635 (+ 1834us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.203650 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.204329 (+ 679us) server_negotiation.cc:407] Connection header received
0810 03:13:10.206159 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.206180 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.206644 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.206935 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.208758 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.209984 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.211235 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.212109 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.212240 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.216489 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.216500 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.216514 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.216566 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.219769 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.220436 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.220445 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.220452 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.220654 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.221008 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.221013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.221017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.221592 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.221877 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.222667 (+ 790us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.222929 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1593,"thread_start_us":1366,"threads_started":1}
I20260810 03:13:10.223987 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.207831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48400)
0810 03:13:10.208455 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.208501 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.208663 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.210681 (+ 2018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.210688 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.211284 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.211646 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.211659 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.212965 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.212970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.213964 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.213976 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.214908 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.214913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.215082 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.215664 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.215686 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.217935 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.221221 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.221230 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.221235 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.221652 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.222066 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.222069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.222071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.222248 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.222838 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.222845 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.222996 (+ 151us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.223172 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.223474 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":243,"threads_started":1}
I20260810 03:13:10.224252 28565 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
I20260810 03:13:10.226724 28877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.125@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
I20260810 03:13:10.237648 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.227447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55356)
0810 03:13:10.227609 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.227626 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.227720 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.227965 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.227968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.228258 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.228379 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.228387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.229244 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.229247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.230066 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.230076 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.230672 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.230676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.230792 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.231197 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.231211 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.233275 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.235689 (+ 2414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.235693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.235696 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.236123 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.236399 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.236402 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.236405 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.236519 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.236969 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.236972 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.237123 (+ 151us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.237228 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.237418 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 03:13:10.237921 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.227362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55356 (local address 127.18.112.125:35539)
0810 03:13:10.227503 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.227507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.227692 (+ 185us) server_negotiation.cc:407] Connection header received
0810 03:13:10.227784 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.227787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.227869 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.227942 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.228486 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.229120 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.230177 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.230556 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.230644 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.233430 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.233434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.233437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.233463 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.235573 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.236213 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.236216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.236218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.236323 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.236605 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.236608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.236610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.236876 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.236974 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.237306 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.237533 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":46}
I20260810 03:13:10.242650 28877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Bootstrap starting.
I20260810 03:13:10.245607 28877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:10.246575 28877 log.cc:824] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:10.249029 28877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: No bootstrap required, opened a new log
I20260810 03:13:10.255700 28877 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } }
I20260810 03:13:10.256027 28877 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:10.256115 28877 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b1c90f841d45e8a98f3c46dd152448, State: Initialized, Role: FOLLOWER
I20260810 03:13:10.256652 28877 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } }
I20260810 03:13:10.257433 28887 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } } }
I20260810 03:13:10.257717 28887 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:10.258270 28877 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:13:10.265940 28902 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:13:10.266063 28902 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:13:10.268038 28776 master_runner.cc:428] Detected that this master d6b1c90f841d45e8a98f3c46dd152448 is joining an existing cluster
I20260810 03:13:10.268121 28776 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.112.125:35539
I20260810 03:13:10.287931 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.271787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55372 (local address 127.18.112.125:35539)
0810 03:13:10.272006 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.272013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.273061 (+ 1048us) server_negotiation.cc:407] Connection header received
0810 03:13:10.273203 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.273208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.273267 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.273365 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.274622 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.275621 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.277484 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.278250 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.278340 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.281145 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.281151 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.281155 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.281191 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.285147 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.285921 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.285925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.285928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.286064 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.286450 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.286454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.286457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.286772 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.286925 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.287384 (+ 459us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.287578 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 03:13:10.288440 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.271465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.18.112.126:33079)
0810 03:13:10.271658 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.271665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.272625 (+ 960us) server_negotiation.cc:407] Connection header received
0810 03:13:10.272914 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.272919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.272997 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.273075 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.274255 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.275200 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.277438 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.278093 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.278192 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.280867 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.280877 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.280882 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.280921 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.284307 (+ 3386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.285810 (+ 1503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.285816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.285819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.285979 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.286448 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.286453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.286456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.286816 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.286958 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.287554 (+ 596us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.287830 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:13:10.288727 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.271880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55372)
0810 03:13:10.272963 (+ 1083us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.272980 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.273095 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.273403 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.273408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.274140 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.274476 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.274489 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.276174 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.276178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.277358 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.277373 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.278653 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.278660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.278845 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.279721 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.279741 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.280883 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.285275 (+ 4392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.285279 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.285282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.285807 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.286188 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.286192 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.286195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.286358 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.286984 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.286988 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.287144 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.288100 (+ 956us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.288353 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":349,"threads_started":1}
I20260810 03:13:10.289767 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.271579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48406)
0810 03:13:10.272520 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.272541 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.272743 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.273237 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.273241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.273797 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.274109 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.274119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.275343 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.275349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.277266 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.277282 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.278478 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.278488 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.278662 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.279324 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.279348 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.280512 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.284461 (+ 3949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.284467 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.284471 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.285662 (+ 1191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.286126 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.286131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.286134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.286305 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.287043 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.287048 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.287243 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.288978 (+ 1735us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.289278 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":1,"thread_start_us":1036,"threads_started":1}
WARNING: no policy specified for oryx/127.18.112.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.124@KRBTEST.COM" created.
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331588, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.126@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
I20260810 03:13:10.316401 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.295565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.18.112.125:35539)
0810 03:13:10.295730 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.295736 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.300173 (+ 4437us) server_negotiation.cc:407] Connection header received
0810 03:13:10.300527 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.300533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.300646 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.300728 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.302346 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.303403 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.305428 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.305890 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.305982 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.310232 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.310238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.310242 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.310275 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.313431 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.314064 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.314068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.314071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.314240 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.314671 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.314676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.314680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.314986 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.315105 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.315761 (+ 656us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.316056 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:13:10.317116 28927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.295512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55386)
0810 03:13:10.300027 (+ 4515us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.300078 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.300311 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.301014 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.301021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.301842 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.302146 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.302159 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.303526 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.303532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.305293 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.305309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.306043 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.306049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.306248 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.307298 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.307321 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.310036 (+ 2715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.313551 (+ 3515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.313561 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.313566 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.313942 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.314381 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.314385 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.314389 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.314550 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.315210 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.315218 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.315420 (+ 202us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.316383 (+ 963us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.316719 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4241,"thread_start_us":4103,"threads_started":1}
I20260810 03:13:10.319111 28054 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.112.125:35539: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448"
member_type: NON_VOTER
last_known_addr {
host: "127.18.112.125"
port: 35539
}
attrs {
promote: true
}
}
dest_uuid: "62cd9d90c58d4f69b807c5b387c8c19f"
cas_config_opid_index: -1
I20260810 03:13:10.320291 28054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } }
I20260810 03:13:10.328255 28932 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } }
I20260810 03:13:10.329210 28841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:10.332451 28932 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.112.125:35539
I20260810 03:13:10.332882 28932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } }
I20260810 03:13:10.333094 28932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:10.333344 28776 master.cc:537] Master@127.18.112.125:35539 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.124.keytab.
Entry for principal oryx/127.18.112.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.124.keytab.
I20260810 03:13:10.334939 28841 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Refusing update from remote peer 62cd9d90c58d4f69b807c5b387c8c19f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 03:13:10.336589 28933 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:10.336875 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:45175
--webserver_interface=127.18.112.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.124.keytab
--principal=oryx/127.18.112.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:10.340202 28033 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260810 03:13:10.347885 28776 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 03:13:10.347874 28033 consensus_peers.cc:487] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f -> Peer d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125:35539): Couldn't send request to peer d6b1c90f841d45e8a98f3c46dd152448. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 03:13:10.348320 28776 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:10.348507 28776 tablet_replica.cc:330] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: stopping tablet replica
I20260810 03:13:10.354604 28776 master.cc:552] Master@127.18.112.125:35539 shutdown complete.
I20260810 03:13:10.354684 28776 master_runner.cc:305] Clearing existing system tablet
I20260810 03:13:10.355022 28776 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:10.355113 28776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:10.357335 28776 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 03:13:10.358683 28942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:10.358996 28776 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:10.359265 28776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 03:13:10.359354 28776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "d6b1c90f841d45e8a98f3c46dd152448"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "9dba2ed911df28f7000106160fa68064"
server_key_iv: "3b73f39df84ee56c7d00c8e6993d6336"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.362847 28776 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:10.367427 28776 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 03:13:10.367578 28776 log.cc:1196] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 03:13:10.368043 28776 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Deleting consensus metadata
I20260810 03:13:10.368322 28776 master_runner.cc:315] Copying system tablet from 127.18.112.126:33079
I20260810 03:13:10.373311 28776 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: tablet copy: Beginning tablet copy session from remote peer at address 127.18.112.126:33079
I20260810 03:13:10.387182 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.374073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48414 (local address 127.18.112.126:33079)
0810 03:13:10.374283 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.374290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.376309 (+ 2019us) server_negotiation.cc:407] Connection header received
0810 03:13:10.376541 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.376545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.376625 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.376718 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:10.377586 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.378311 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.379503 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.380063 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.380177 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.382140 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:10.382145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:10.382149 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:10.382178 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:10.384723 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.385313 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.385318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.385322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.385450 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:10.385815 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:10.385820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:10.385824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:10.386084 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:10.386226 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.386624 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.386826 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:13:10.387212 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.374015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48414)
0810 03:13:10.376198 (+ 2183us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.376218 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.376418 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.376766 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.376770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.377237 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:10.377438 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.377447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.378456 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.378461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.379368 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.379380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.380205 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.380211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.380392 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.380990 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:10.381014 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:10.381827 (+ 813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:10.384844 (+ 3017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.384850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.384855 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.385204 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.385554 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:10.385559 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:10.385563 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:10.385704 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:10.386209 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:10.386215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:10.386375 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.386506 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.386780 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2068,"thread_start_us":1921,"threads_started":1}
I20260810 03:13:10.388188 28088 tablet_copy_service.cc:140] P 62cd9d90c58d4f69b807c5b387c8c19f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d6b1c90f841d45e8a98f3c46dd152448 ({username='oryx', principal='oryx/127.18.112.125@KRBTEST.COM'} at 127.0.0.1:48414)
I20260810 03:13:10.388435 28088 tablet_copy_service.cc:161] P 62cd9d90c58d4f69b807c5b387c8c19f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d6b1c90f841d45e8a98f3c46dd152448 at {username='oryx', principal='oryx/127.18.112.125@KRBTEST.COM'} at 127.0.0.1:48414: session id = d6b1c90f841d45e8a98f3c46dd152448-00000000000000000000000000000000
I20260810 03:13:10.391351 28088 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 03:13:10.393451 28776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 03:13:10.397814 28776 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: tablet copy: Starting download of 0 data blocks...
I20260810 03:13:10.398082 28776 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: tablet copy: Starting download of 1 WAL segments...
I20260810 03:13:10.400385 28776 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 03:13:10.403618 28088 tablet_copy_service.cc:342] P 62cd9d90c58d4f69b807c5b387c8c19f: Request end of tablet copy session d6b1c90f841d45e8a98f3c46dd152448-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.112.125@KRBTEST.COM'} at 127.0.0.1:48414
I20260810 03:13:10.403936 28088 tablet_copy_service.cc:433] P 62cd9d90c58d4f69b807c5b387c8c19f: ending tablet copy session d6b1c90f841d45e8a98f3c46dd152448-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d6b1c90f841d45e8a98f3c46dd152448
I20260810 03:13:10.413522 28776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:10.415877 28949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.428678 28953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.428702 28951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:10.429344 28776 server_base.cc:1034] running on GCE node
I20260810 03:13:10.429661 28776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:10.430234 28776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:10.431429 28776 hybrid_clock.cc:648] HybridClock initialized: now 1786331590431376 us; error 27 us; skew 500 ppm
I20260810 03:13:10.431643 28776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:10.433404 28776 init.cc:377] Logged in from keytab as oryx/127.18.112.125@KRBTEST.COM (short username oryx)
I20260810 03:13:10.434584 28776 webserver.cc:460] Webserver started at http://127.18.112.125:43311/ using document root <none> and password file <none>
I20260810 03:13:10.434892 28776 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:10.434966 28776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:10.437220 28776 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:13:10.438946 28960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:10.439385 28776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 03:13:10.439528 28776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "d6b1c90f841d45e8a98f3c46dd152448"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "9dba2ed911df28f7000106160fa68064"
server_key_iv: "3b73f39df84ee56c7d00c8e6993d6336"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.439692 28776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:10.454932 28776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:10.458024 28776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:10.486261 28776 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.125:35539
I20260810 03:13:10.486279 29041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.125:35539 every 8 connection(s)
I20260810 03:13:10.487250 28776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
I20260810 03:13:10.492918 29042 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:13:10.496116 29042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Bootstrap starting.
I20260810 03:13:10.508481 29042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:13:10.508898 29042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: Bootstrap complete.
I20260810 03:13:10.509759 29042 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } }
I20260810 03:13:10.510016 29042 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b1c90f841d45e8a98f3c46dd152448, State: Initialized, Role: LEARNER
I20260810 03:13:10.510239 29042 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } }
I20260810 03:13:10.510972 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } }
I20260810 03:13:10.511232 29042 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:10.511418 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:13:10.520062 29061 catalog_manager.cc:1259] Loaded cluster ID: b3f0eeeb65fc4075bd93f7c37a77081a
I20260810 03:13:10.520160 29061 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: loading cluster ID for follower catalog manager: success
I20260810 03:13:10.522648 29061 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: acquiring CA information for follower catalog manager: success
I20260810 03:13:10.524549 29061 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:13:10.716897 28765 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
W20260810 03:13:10.813638 28937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:10.814019 28937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:10.814294 28937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:10.824744 28937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:10.824932 28937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:10.825057 28937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:10.825363 28937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:10.825486 28937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:10.839282 28937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.124.keytab
--principal=oryx/127.18.112.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:45175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.112.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:10.841296 28937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:10.842887 28937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:10.858419 29067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.858400 29068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:10.858538 29071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:10.864594 28937 server_base.cc:1034] running on GCE node
I20260810 03:13:10.865486 28937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:10.867298 28937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:10.868556 28937 hybrid_clock.cc:648] HybridClock initialized: now 1786331590868475 us; error 65 us; skew 500 ppm
I20260810 03:13:10.868944 28937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:10 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:10.877149 28937 init.cc:377] Logged in from keytab as oryx/127.18.112.124@KRBTEST.COM (short username oryx)
I20260810 03:13:10.879452 28937 webserver.cc:460] Webserver started at http://127.18.112.124:45599/ using document root <none> and password file <none>
I20260810 03:13:10.880599 28937 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:10.880839 28937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:10.881300 28937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:10.885545 28937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/instance:
uuid: "414a790f150e479689c880eadb55caef"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "5aa09d4adaced4118ec5d256ca6b89aa"
server_key_iv: "3c9a8c3b5532bd815e90934a373033cd"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.886574 28937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal/instance:
uuid: "414a790f150e479689c880eadb55caef"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "5aa09d4adaced4118ec5d256ca6b89aa"
server_key_iv: "3c9a8c3b5532bd815e90934a373033cd"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.893576 28937 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260810 03:13:10.897887 29079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:10.899319 28937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:13:10.899555 28937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "414a790f150e479689c880eadb55caef"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "5aa09d4adaced4118ec5d256ca6b89aa"
server_key_iv: "3c9a8c3b5532bd815e90934a373033cd"
server_key_version: "encryptionkey@0"
I20260810 03:13:10.899863 28937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:10.928833 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.919928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55392)
0810 03:13:10.920526 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:10.920572 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:10.920722 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:10.921631 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:10.921636 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:10.921666 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:10.922034 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.922045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.923911 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.923917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.926356 (+ 2439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:10.926372 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.927887 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.927894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:10.928105 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.928163 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 03:13:10.928256 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 03:13:10.928384 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":268,"threads_started":1}
I20260810 03:13:10.928850 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.920178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55392 (local address 127.18.112.125:35539)
0810 03:13:10.921298 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.921303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.921320 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:13:10.921394 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.921399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.921479 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.921579 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:10.922172 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.923728 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.926577 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:10.927655 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:10.927851 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:10.927981 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:10.928275 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 03:13:10.928401 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":782,"threads_started":1}
I20260810 03:13:10.930452 28997 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260810 03:13:10.931241 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62cd9d90c58d4f69b807c5b387c8c19f. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } }
I20260810 03:13:10.931577 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:13:10.939214 28937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:10.945101 28937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:10.945422 28937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:10.985472 28937 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.124:45175
I20260810 03:13:10.985610 29158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.124:45175 every 8 connection(s)
I20260810 03:13:10.987064 28937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
I20260810 03:13:10.990391 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 28937
I20260810 03:13:10.991925 29160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:11.004354 29160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.124@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:11.023139 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:10.993242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43980 (local address 127.18.112.124:45175)
0810 03:13:10.994574 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:10.994584 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:10.994652 (+ 68us) server_negotiation.cc:407] Connection header received
0810 03:13:10.997983 (+ 3331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:10.998004 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:10.998444 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:10.998794 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.001293 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.003283 (+ 1990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.005827 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.006549 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.006682 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.013797 (+ 7115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.013813 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.013828 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.013912 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.018439 (+ 4527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.019203 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.019212 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.019219 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.019424 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.019885 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.019890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.019893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.020560 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.020992 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.021388 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.021761 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1054,"thread_start_us":567,"threads_started":1}
I20260810 03:13:11.029676 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.008183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48422)
0810 03:13:11.009167 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.009207 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.009452 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.009954 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.009959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.010870 (+ 911us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.011637 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.011653 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.013584 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.013590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.016237 (+ 2647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.016253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.017594 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.017612 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.017947 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.018789 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.018805 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.022146 (+ 3341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.026876 (+ 4730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.026888 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.026894 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.027365 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.027721 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.027726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.027728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.027893 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.028403 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.028410 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.028572 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.028750 (+ 178us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.029059 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":602,"threads_started":1}
I20260810 03:13:11.029763 29169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.007867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48422 (local address 127.18.112.126:33079)
0810 03:13:11.008750 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.008756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.009312 (+ 556us) server_negotiation.cc:407] Connection header received
0810 03:13:11.009629 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.009635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.009761 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.009891 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.011821 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.013424 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.016398 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.017248 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.017380 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.022337 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.022342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.022345 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.022376 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.026748 (+ 4372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.027488 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.027492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.027502 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.027618 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.028001 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.028005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.028007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.028279 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.028408 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.028929 (+ 521us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.029126 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":552,"threads_started":1}
I20260810 03:13:11.031034 29160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.124@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
I20260810 03:13:11.045169 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.031829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.18.112.125:35539)
0810 03:13:11.032001 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.032006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.032023 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:13:11.032071 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.032075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.032132 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.032208 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.032806 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.033676 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.035083 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.035608 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.035742 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.038861 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.038866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.038869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.038900 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.042728 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.043573 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.043577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.043579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.043708 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.044110 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.044113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.044115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.044381 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.044492 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.044754 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.044923 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:13:11.045298 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.031656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55396)
0810 03:13:11.031864 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.031881 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.031967 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.032233 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.032236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.032566 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.032692 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.032700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.033786 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.033789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.034944 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.034956 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.035799 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.035861 (+ 62us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.036064 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.036535 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.036551 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.038675 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.042849 (+ 4174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.042853 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.042855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.043474 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.043788 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.043791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.043793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.044019 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.044465 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.044468 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.044571 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.044675 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.044924 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 03:13:11.046311 29160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331590, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.124@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
I20260810 03:13:11.060801 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.046985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:43992)
0810 03:13:11.047133 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.047175 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.047278 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.047866 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.047869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.048384 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.048555 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.048563 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.049749 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.049755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.051010 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.051022 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.051896 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.051900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.052089 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.052627 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.052650 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.055214 (+ 2564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.058546 (+ 3332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.058549 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.058552 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.058954 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.059296 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.059300 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.059302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.059479 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.060060 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.060064 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.060181 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.060285 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.060441 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 03:13:11.061079 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.047483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.18.112.124:45175)
0810 03:13:11.047631 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.047635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.047648 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:13:11.047682 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.047685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.047732 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.047823 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.048669 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.049617 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.051130 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.051735 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.051849 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.055431 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.055435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.055438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.055466 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.058428 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.059046 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.059050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.059052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.059206 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.059570 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.059573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.059575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.059952 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.060059 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.060424 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.060666 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:13:11.066689 29160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Bootstrap starting.
I20260810 03:13:11.071286 29160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:11.073457 29160 log.cc:824] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:11.077616 29160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: No bootstrap required, opened a new log
I20260810 03:13:11.088209 29160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } }
I20260810 03:13:11.088670 29160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:11.088869 29160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414a790f150e479689c880eadb55caef, State: Initialized, Role: FOLLOWER
I20260810 03:13:11.089550 29160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } }
I20260810 03:13:11.090943 29174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } } }
I20260810 03:13:11.091619 29174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:11.092139 29160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:13:11.105587 29186 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:13:11.105803 29186 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:13:11.110239 28937 master_runner.cc:428] Detected that this master 414a790f150e479689c880eadb55caef is joining an existing cluster
I20260810 03:13:11.110420 28937 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.112.124:45175
I20260810 03:13:11.126557 29174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:11.127082 29174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } }
I20260810 03:13:11.130280 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28166
I20260810 03:13:11.130023 28072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "414a790f150e479689c880eadb55caef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" is_pre_election: true
I20260810 03:13:11.130033 28997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "414a790f150e479689c880eadb55caef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b1c90f841d45e8a98f3c46dd152448" is_pre_election: true
I20260810 03:13:11.129524 29174 leader_election.cc:288] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079), d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125:35539)
I20260810 03:13:11.132906 29081 leader_election.cc:302] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 414a790f150e479689c880eadb55caef; no voters: 62cd9d90c58d4f69b807c5b387c8c19f, d6b1c90f841d45e8a98f3c46dd152448
I20260810 03:13:11.133821 29174 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 03:13:11.144392 29201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.117463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48430)
0810 03:13:11.118840 (+ 1377us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.118863 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.119399 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.119891 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.119896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.121272 (+ 1376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.121990 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.122005 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.123905 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.123911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.126095 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.126110 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.128213 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.128224 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.128531 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.133418 (+ 4887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.133443 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.134912 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.140090 (+ 5178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.140095 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.140099 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.140804 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.141308 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.141312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.141315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.141552 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.142448 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.142452 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.142896 (+ 444us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.143098 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.143514 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1173,"mutex_wait_us":3,"thread_start_us":803,"threads_started":1}
I20260810 03:13:11.145605 29169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.117014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48430 (local address 127.18.112.126:33079)
0810 03:13:11.117197 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.117203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.118955 (+ 1752us) server_negotiation.cc:407] Connection header received
0810 03:13:11.119606 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.119612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.119710 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.119834 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.122144 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.123705 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.126588 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.127544 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.127649 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.135225 (+ 7576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.135232 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.135237 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.135279 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.139924 (+ 4645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.140935 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.140941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.140944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.141182 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.141689 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.141695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.141698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.142209 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.142392 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.144754 (+ 2362us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.145014 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.65@KRBTEST.COM
I20260810 03:13:11.160070 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.119076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44006 (local address 127.18.112.124:45175)
0810 03:13:11.119298 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.119304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.134616 (+ 15312us) server_negotiation.cc:407] Connection header received
0810 03:13:11.134866 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.134871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.134931 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.134994 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.137060 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.138601 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.141302 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.142371 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.142453 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.151117 (+ 8664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.151123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.151128 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.151161 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.156630 (+ 5469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.157505 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.157510 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.157513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.157714 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.158273 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.158277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.158281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.158763 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.158886 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.159411 (+ 525us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.159617 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":59}
I20260810 03:13:11.167544 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.118732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:44006)
0810 03:13:11.134528 (+ 15796us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.134547 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.134731 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.135173 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.135176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.136051 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.136900 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.136915 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.138859 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.138863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.141170 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.141183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.143032 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.143040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.143280 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.149203 (+ 5923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.149296 (+ 93us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.150917 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.156771 (+ 5854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.156775 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.156779 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.157398 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.157827 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.157832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.157835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.158152 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.158951 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.158955 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.159129 (+ 174us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.161027 (+ 1898us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.161383 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15618,"thread_start_us":16949,"threads_started":1}
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331588, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.126@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
I20260810 03:13:11.176111 29204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.132446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33490 (local address 127.18.112.65:38421)
0810 03:13:11.134264 (+ 1818us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.134275 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.134308 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:13:11.134381 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.134391 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.134664 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.137209 (+ 2545us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.137590 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.139551 (+ 1961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.141762 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.142843 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.143701 (+ 858us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.154616 (+ 10915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.162133 (+ 7517us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.162160 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.162247 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.168284 (+ 6037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.172042 (+ 3758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.172053 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.172057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.172331 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.173017 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.173022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.173026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.173590 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.174079 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.175064 (+ 985us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.175421 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1623,"thread_start_us":1536,"threads_started":1}
I20260810 03:13:11.177873 28351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:11.186167 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.155855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:44014)
0810 03:13:11.156247 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.156273 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.156371 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.160829 (+ 4458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.160833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.161338 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.161539 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.161550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.164223 (+ 2673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.164229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.165997 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.166013 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.168493 (+ 2480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.168501 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.168832 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.169608 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.169632 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.173206 (+ 3574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.180324 (+ 7118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.180330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.180335 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.181256 (+ 921us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.182373 (+ 1117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.182378 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.182382 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.182638 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.184851 (+ 2213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.184857 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.185094 (+ 237us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.185277 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.185610 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281}
I20260810 03:13:11.187404 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.156572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44014 (local address 127.18.112.124:45175)
0810 03:13:11.160515 (+ 3943us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.160521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.160536 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:13:11.160612 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.160621 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.160692 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.160792 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.161711 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.164057 (+ 2346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.166199 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.167337 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.169226 (+ 1889us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.173446 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.173454 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.173459 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.173495 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.180101 (+ 6606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.182005 (+ 1904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.182011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.182014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.182217 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.182965 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.182974 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.182977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.184166 (+ 1189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.186610 (+ 2444us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.186775 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.187040 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3854,"thread_start_us":17932,"threads_started":1}
I20260810 03:13:11.189035 28054 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.112.124:45175: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "414a790f150e479689c880eadb55caef"
member_type: NON_VOTER
last_known_addr {
host: "127.18.112.124"
port: 45175
}
attrs {
promote: true
}
}
dest_uuid: "62cd9d90c58d4f69b807c5b387c8c19f"
cas_config_opid_index: 5
I20260810 03:13:11.190215 28054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } }
I20260810 03:13:11.192947 29085 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 414a790f150e479689c880eadb55caef (127.18.112.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.197201 28997 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Refusing update from remote peer 62cd9d90c58d4f69b807c5b387c8c19f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260810 03:13:11.198185 29095 tablet.cc:2369] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:13:11.201520 29085 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.112.124:45175
I20260810 03:13:11.204013 29202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.124560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:55406)
0810 03:13:11.135550 (+ 10990us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.135573 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.135944 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.136495 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.136499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.139346 (+ 2847us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.148856 (+ 9510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.148874 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.157955 (+ 9081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.157960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.161703 (+ 3743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.161714 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.168018 (+ 6304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.168034 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.168216 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.192434 (+ 24218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.192459 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.194194 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.200112 (+ 5918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.200117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.200121 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.200861 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.201452 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.201458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.201462 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.201735 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.202529 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.202534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.202808 (+ 274us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.202966 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.203305 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10692,"thread_start_us":7314,"threads_started":1}
I20260810 03:13:11.204432 28937 master.cc:537] Master@127.18.112.124:45175 shutting down...
I20260810 03:13:11.205255 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.117396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.18.112.125:35539)
0810 03:13:11.117620 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.117629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.135660 (+ 18031us) server_negotiation.cc:407] Connection header received
0810 03:13:11.136135 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.136141 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.136228 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.136297 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.148998 (+ 12701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.150443 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.162169 (+ 11726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.162903 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.162981 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.194549 (+ 31568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.194559 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.194565 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.194618 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.199902 (+ 5284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.201019 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.201025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.201030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.201307 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.201877 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.201882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.201886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.202308 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.202451 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.204447 (+ 1996us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.204764 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:13:11.205171 29207 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 03:13:11.205773 29085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.206534 29085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:11.208630 28997 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 414a790f150e479689c880eadb55caef (127.18.112.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.218156 28937 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:11.218561 28937 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:11.218895 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: NON_VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: true } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.219202 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:13:11.219406 28937 tablet_replica.cc:330] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: stopping tablet replica
I20260810 03:13:11.221565 29207 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: attempting to promote NON_VOTER d6b1c90f841d45e8a98f3c46dd152448 to VOTER
I20260810 03:13:11.222457 29207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } }
I20260810 03:13:11.228629 28937 master.cc:552] Master@127.18.112.124:45175 shutdown complete.
I20260810 03:13:11.228744 28937 master_runner.cc:305] Clearing existing system tablet
I20260810 03:13:11.229158 28937 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:11.229279 28937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:11.239010 28937 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.002s sys 0.001s
I20260810 03:13:11.243237 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.242783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:44026)
0810 03:13:11.242927 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.243057 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:45175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 03:13:11.243422 28997 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 LEARNER]: Refusing update from remote peer 62cd9d90c58d4f69b807c5b387c8c19f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 03:13:11.244155 29207 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 03:13:11.245026 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.244627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:44030)
0810 03:13:11.244797 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.244878 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:45175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:13:11.245290 28029 consensus_peers.cc:487] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f -> Peer 414a790f150e479689c880eadb55caef (127.18.112.124:45175): Couldn't send request to peer 414a790f150e479689c880eadb55caef. Status: Network error: Client connection negotiation failed: client connection to 127.18.112.124:45175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 03:13:11.246421 29085 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.246773 29217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:11.247090 28937 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:11.247342 28937 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260810 03:13:11.247048 28997 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.247450 28937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "414a790f150e479689c880eadb55caef"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "5aa09d4adaced4118ec5d256ca6b89aa"
server_key_iv: "3c9a8c3b5532bd815e90934a373033cd"
server_key_version: "encryptionkey@0"
I20260810 03:13:11.252409 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.252749 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:11.253216 28937 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:11.257659 29208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.258127 29208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:11.258460 29085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.258800 29085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:11.261390 28937 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 03:13:11.261708 28937 log.cc:1196] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 03:13:11.262439 28937 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Deleting consensus metadata
I20260810 03:13:11.262735 28937 master_runner.cc:315] Copying system tablet from 127.18.112.126:33079
I20260810 03:13:11.274052 28937 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: tablet copy: Beginning tablet copy session from remote peer at address 127.18.112.126:33079
I20260810 03:13:11.294853 29169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.274859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.18.112.126:33079)
0810 03:13:11.275150 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.275156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.276676 (+ 1520us) server_negotiation.cc:407] Connection header received
0810 03:13:11.276926 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.276932 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.277027 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.277138 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:11.278684 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.280083 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.282219 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.283362 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.283492 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.286215 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:11.286222 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:11.286228 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:11.286266 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:11.291260 (+ 4994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.292081 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.292088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.292091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.292313 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:11.292744 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:11.292749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:11.292753 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:11.293309 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:11.293448 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.294059 (+ 611us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.294383 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260810 03:13:11.295111 29225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.274970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:48434)
0810 03:13:11.276496 (+ 1526us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.276517 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.276775 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.277174 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.277180 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.278088 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:11.278523 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.278538 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.280273 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.280279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.282081 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.282097 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.283795 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.283825 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.283998 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.284836 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:11.284867 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:11.285999 (+ 1132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:11.291395 (+ 5396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.291401 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.291405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.291961 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.292433 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:11.292438 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:11.292443 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:11.292631 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:11.293518 (+ 887us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:11.293524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:11.293738 (+ 214us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.293883 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.294326 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1264,"thread_start_us":1156,"threads_started":1}
I20260810 03:13:11.295935 28088 tablet_copy_service.cc:140] P 62cd9d90c58d4f69b807c5b387c8c19f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 414a790f150e479689c880eadb55caef ({username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:48434)
I20260810 03:13:11.296233 28088 tablet_copy_service.cc:161] P 62cd9d90c58d4f69b807c5b387c8c19f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 414a790f150e479689c880eadb55caef at {username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:48434: session id = 414a790f150e479689c880eadb55caef-00000000000000000000000000000000
I20260810 03:13:11.300748 28088 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 03:13:11.302949 28937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 03:13:11.311949 28937 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: tablet copy: Starting download of 0 data blocks...
I20260810 03:13:11.312377 28937 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: tablet copy: Starting download of 1 WAL segments...
I20260810 03:13:11.315708 28937 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 03:13:11.320986 28088 tablet_copy_service.cc:342] P 62cd9d90c58d4f69b807c5b387c8c19f: Request end of tablet copy session 414a790f150e479689c880eadb55caef-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:48434
I20260810 03:13:11.321177 28088 tablet_copy_service.cc:433] P 62cd9d90c58d4f69b807c5b387c8c19f: ending tablet copy session 414a790f150e479689c880eadb55caef-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 414a790f150e479689c880eadb55caef
I20260810 03:13:11.329519 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28166
I20260810 03:13:11.342798 28937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:11.349471 29229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:11.350698 29231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:11.357734 29234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:11.364032 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:38421
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:33079
--webserver_port=38107
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:13:11.365090 28937 server_base.cc:1034] running on GCE node
I20260810 03:13:11.365466 28937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:11.366124 28937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:11.367331 28937 hybrid_clock.cc:648] HybridClock initialized: now 1786331591367277 us; error 37 us; skew 500 ppm
I20260810 03:13:11.367554 28937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331591, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:11.369683 28937 init.cc:377] Logged in from keytab as oryx/127.18.112.124@KRBTEST.COM (short username oryx)
I20260810 03:13:11.373081 28937 webserver.cc:460] Webserver started at http://127.18.112.124:43585/ using document root <none> and password file <none>
I20260810 03:13:11.373397 28937 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:11.373489 28937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:11.376425 28937 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260810 03:13:11.378328 29245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:11.378767 28937 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260810 03:13:11.378895 28937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "414a790f150e479689c880eadb55caef"
format_stamp: "Formatted at 2026-08-10 03:13:10 on dist-test-slave-jlzn"
server_key: "5aa09d4adaced4118ec5d256ca6b89aa"
server_key_iv: "3c9a8c3b5532bd815e90934a373033cd"
server_key_version: "encryptionkey@0"
I20260810 03:13:11.379068 28937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:11.433077 28937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:11.437244 28937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:11.468758 28937 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.124:45175
I20260810 03:13:11.468809 29324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.124:45175 every 8 connection(s)
I20260810 03:13:11.469942 28937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
I20260810 03:13:11.475219 29325 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:13:11.479234 29325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Bootstrap starting.
I20260810 03:13:11.515957 29325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:13:11.516490 29325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Bootstrap complete.
I20260810 03:13:11.517642 29325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } }
I20260810 03:13:11.517956 29325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 414a790f150e479689c880eadb55caef, State: Initialized, Role: LEARNER
I20260810 03:13:11.518244 29325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } }
I20260810 03:13:11.519345 29331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.519630 29325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:11.519796 29331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: LEARNER
I20260810 03:13:11.532730 29345 catalog_manager.cc:1259] Loaded cluster ID: b3f0eeeb65fc4075bd93f7c37a77081a
I20260810 03:13:11.532826 29345 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: loading cluster ID for follower catalog manager: success
I20260810 03:13:11.536274 29345 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: acquiring CA information for follower catalog manager: success
I20260810 03:13:11.538817 29345 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:13:11.776969 29352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.766062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53542 (local address 127.18.112.124:45175)
0810 03:13:11.770458 (+ 4396us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:11.770465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:11.770948 (+ 483us) server_negotiation.cc:407] Connection header received
0810 03:13:11.771174 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:11.771178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:11.771268 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:11.771375 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:11.771878 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.772808 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.775130 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.775958 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.776109 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.776250 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:11.776604 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 03:13:11.776707 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4243,"thread_start_us":4111,"threads_started":1}
I20260810 03:13:11.777190 29351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:11.765853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:53542)
0810 03:13:11.770813 (+ 4960us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:11.770841 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:11.771037 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:11.771426 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:11.771432 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:11.771464 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:11.771721 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.771734 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.772946 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.772951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.774979 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:11.774994 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:11.776183 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:11.776189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:11.776439 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:11.776476 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:13:11.776578 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 03:13:11.776716 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4824,"thread_start_us":4724,"threads_started":1}
I20260810 03:13:11.778381 29287 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 03:13:11.778986 29331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62cd9d90c58d4f69b807c5b387c8c19f. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:11.779280 29331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: LEARNER
W20260810 03:13:11.816183 29243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:11.816500 29243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:11.816627 29243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:11.826450 29243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:11.826639 29243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:11.826836 29243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:11.839010 29243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:38421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=38107
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:11.840426 29243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:11.842041 29243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:11.859156 29361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:11.859707 29357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:11.859325 29358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:11.860808 29243 server_base.cc:1034] running on GCE node
I20260810 03:13:11.861387 29243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:11.862304 29243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:11.863574 29243 hybrid_clock.cc:648] HybridClock initialized: now 1786331591863458 us; error 38 us; skew 500 ppm
I20260810 03:13:11.864032 29243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:11 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331591, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:11.867760 29243 init.cc:377] Logged in from keytab as oryx/127.18.112.65@KRBTEST.COM (short username oryx)
I20260810 03:13:11.869779 29243 webserver.cc:460] Webserver started at http://127.18.112.65:38107/ using document root <none> and password file <none>
I20260810 03:13:11.870661 29243 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:11.870889 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:11.877875 29243 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 03:13:11.881055 29374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:11.882375 29243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:11.882562 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "a8a9a2c992664c778eb5515a7184efe2"
format_stamp: "Formatted at 2026-08-10 03:13:08 on dist-test-slave-jlzn"
server_key: "ad5c01222613b62b1cd614595f1a68d2"
server_key_iv: "ca136539e0299c8a9eca928b9a2387c0"
server_key_version: "encryptionkey@0"
I20260810 03:13:11.883942 29243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:11.911993 29243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:11.917089 29243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:11.917606 29243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:11.919036 29243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:11.921072 29243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:11.921173 29243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:11.921310 29243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:11.921427 29243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:11.996191 29243 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:38421
I20260810 03:13:11.996532 29554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:38421 every 8 connection(s)
I20260810 03:13:11.997784 29243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:12.003607 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 29243
I20260810 03:13:12.004122 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28363
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331591, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331591, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.66@KRBTEST.COM
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331591, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:12.045585 29352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.001539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:38615 (local address 127.18.112.124:45175)
0810 03:13:12.001731 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.001736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.014424 (+ 12688us) server_negotiation.cc:407] Connection header received
0810 03:13:12.018985 (+ 4561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.018992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.019079 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.019198 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.023326 (+ 4128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.024661 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.028624 (+ 3963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.029538 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.029626 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.036622 (+ 6996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.036627 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.036633 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.036670 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.041304 (+ 4634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.042364 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.042370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.042373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.042603 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.043320 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.043325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.043328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.043767 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.043924 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.044890 (+ 966us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.045117 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:13:12.046070 29561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.002703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39879 (local address 127.18.112.125:35539)
0810 03:13:12.015780 (+ 13077us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.015787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.019541 (+ 3754us) server_negotiation.cc:407] Connection header received
0810 03:13:12.019918 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.019925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.020054 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.020148 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.023604 (+ 3456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.024824 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.029531 (+ 4707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.030387 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.030482 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.036535 (+ 6053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.036541 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.036546 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.036584 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.042272 (+ 5688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.043405 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.043411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.043415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.043593 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.044147 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.044152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.044155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.044558 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.044696 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.045202 (+ 506us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.045462 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12896,"thread_start_us":13122,"threads_started":1}
I20260810 03:13:12.047751 29569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.019594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:32811 (local address 127.18.112.126:33079)
0810 03:13:12.026304 (+ 6710us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.026311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.026330 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:12.026388 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.026393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.026475 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.026593 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.028194 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.029816 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.031998 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.032790 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.032919 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.038707 (+ 5788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.038715 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.038719 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.038758 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.043632 (+ 4874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.044747 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.044752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.044755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.045008 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.045653 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.045658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.045661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.046203 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.046342 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.046940 (+ 598us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.047196 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6549,"thread_start_us":6404,"threads_started":1}
I20260810 03:13:12.048261 29568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.005738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56964 (local address 127.18.112.66:34541)
0810 03:13:12.017089 (+ 11351us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.017098 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.017890 (+ 792us) server_negotiation.cc:407] Connection header received
0810 03:13:12.018081 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.018090 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.018333 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.018501 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.025697 (+ 7196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.027338 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.029388 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.030224 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.030340 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.037442 (+ 7102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.037457 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.037472 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.037513 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.043214 (+ 5701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.044476 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.044485 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.044488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.044715 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.045267 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.045272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.045275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.045702 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.046134 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.047386 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.047616 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11111,"thread_start_us":10783,"threads_started":1}
I20260810 03:13:12.048547 29564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.001979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.18.112.65:38615)
0810 03:13:12.014150 (+ 12171us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.014204 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.018699 (+ 4495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.019780 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.019792 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.021443 (+ 1651us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.023113 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.023139 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.024896 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.024903 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.028462 (+ 3559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.028478 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.030046 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.030056 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.030452 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.031660 (+ 1208us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.031736 (+ 76us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.036399 (+ 4663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.041503 (+ 5104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.041511 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.041526 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.042228 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.042756 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.042760 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.042763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.043175 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.044022 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.044030 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.044462 (+ 432us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.046086 (+ 1624us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.046947 (+ 861us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11752,"mutex_wait_us":41,"thread_start_us":16444,"threads_started":1}
I20260810 03:13:12.049680 28559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:12.050343 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.003074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.18.112.65:39879)
0810 03:13:12.019400 (+ 16326us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.019419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.019718 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.020512 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.020517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.022691 (+ 2174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.023466 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.023477 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.025117 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.025122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.029370 (+ 4248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.029384 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.030962 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.030971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.031179 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.031842 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.031864 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.036279 (+ 4415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.042405 (+ 6126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.042409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.042413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.043276 (+ 863us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.043756 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.043760 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.043763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.044022 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.044775 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.044779 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.044917 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.046308 (+ 1391us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.049267 (+ 2959us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16159,"mutex_wait_us":4148,"spinlock_wait_cycles":49536,"thread_start_us":11398,"threads_started":1}
I20260810 03:13:12.050364 29556 heartbeater.cc:347] Connected to a master server at 127.18.112.124:45175
I20260810 03:13:12.050719 29556 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.051970 29556 heartbeater.cc:511] Master 127.18.112.124:45175 requested a full tablet report, sending...
I20260810 03:13:12.052098 29558 heartbeater.cc:347] Connected to a master server at 127.18.112.125:35539
I20260810 03:13:12.052304 29558 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.053200 29558 heartbeater.cc:511] Master 127.18.112.125:35539 requested a full tablet report, sending...
I20260810 03:13:12.054242 29571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.019630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:32811)
0810 03:13:12.022802 (+ 3172us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.022821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.023083 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.026615 (+ 3532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.026619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.027302 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.028019 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.028033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.029980 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.029985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.031778 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.031793 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.033278 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.033286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.033608 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.034284 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.034309 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.038387 (+ 4078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.043785 (+ 5398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.043789 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.043793 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.044604 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.045161 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.045166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.045169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.045501 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.046408 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.046412 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.046600 (+ 188us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.046784 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.053743 (+ 6959us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2985,"mutex_wait_us":6654,"spinlock_wait_cycles":12160,"thread_start_us":1939,"threads_started":1}
I20260810 03:13:12.055449 29270 ts_manager.cc:194] Registered new tserver with Master: a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
I20260810 03:13:12.057060 28984 ts_manager.cc:194] Registered new tserver with Master: a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
I20260810 03:13:12.058681 29557 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:12.058871 29557 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.060009 29557 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:12.061287 28054 ts_manager.cc:194] Re-registered known tserver with Master: a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
I20260810 03:13:12.062196 28054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:32811
I20260810 03:13:12.135489 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28363
I20260810 03:13:12.152184 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:34541
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:33079
--webserver_port=37191
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:13:12.349113 29574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: NON_VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: true } } }
I20260810 03:13:12.349510 29574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:12.351380 29578 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: attempting to promote NON_VOTER 414a790f150e479689c880eadb55caef to VOTER
I20260810 03:13:12.352339 29578 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } }
I20260810 03:13:12.354842 28997 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Refusing update from remote peer 62cd9d90c58d4f69b807c5b387c8c19f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 03:13:12.354923 29287 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 LEARNER]: Refusing update from remote peer 62cd9d90c58d4f69b807c5b387c8c19f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 03:13:12.355430 29577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 03:13:12.355928 29578 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [LEADER]: Connected to new peer: Peer: permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 03:13:12.359722 29578 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 414a790f150e479689c880eadb55caef (127.18.112.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.360587 29287 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 414a790f150e479689c880eadb55caef (127.18.112.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.361500 28997 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 414a790f150e479689c880eadb55caef (127.18.112.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.363785 29577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.364094 29577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:12.364367 29577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.364598 29577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:12.364893 29577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.365128 29577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:12.368268 29589 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.368652 29589 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:12.369133 29588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:12.369460 29588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: FOLLOWER
W20260810 03:13:12.476231 29573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:12.476473 29573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:12.476606 29573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:12.483786 29573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:12.483911 29573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:12.484061 29573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:12.493466 29573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:34541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=37191
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:12.494590 29573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:12.495837 29573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:12.508139 29597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:12.508214 29598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:12.508358 29600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:12.508970 29573 server_base.cc:1034] running on GCE node
I20260810 03:13:12.509485 29573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:12.510293 29573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:12.511474 29573 hybrid_clock.cc:648] HybridClock initialized: now 1786331592511423 us; error 44 us; skew 500 ppm
I20260810 03:13:12.511766 29573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331592, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:12.514627 29573 init.cc:377] Logged in from keytab as oryx/127.18.112.66@KRBTEST.COM (short username oryx)
I20260810 03:13:12.515950 29573 webserver.cc:460] Webserver started at http://127.18.112.66:37191/ using document root <none> and password file <none>
I20260810 03:13:12.516583 29573 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:12.516716 29573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:12.521864 29573 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:13:12.524320 29609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:12.525586 29573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:12.525734 29573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "3cb3949f331847e1bdde6cffaf7cc115"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "2ec04d95d495833f5433e9d9312d8f2c"
server_key_iv: "77d9d36426c868d6deb2186773dac7cb"
server_key_version: "encryptionkey@0"
I20260810 03:13:12.526669 29573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:12.557582 29573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:12.561252 29573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:12.561502 29573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:12.562414 29573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:12.563688 29573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:12.563783 29573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:12.563913 29573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:12.563988 29573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:12.594107 29573 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:34541
I20260810 03:13:12.594177 29791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:34541 every 8 connection(s)
I20260810 03:13:12.595450 29573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:12.604537 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 29573
I20260810 03:13:12.604861 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28571
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331592, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331592, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331592, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
I20260810 03:13:12.629294 29801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.599255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:54637)
0810 03:13:12.600913 (+ 1658us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.600971 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.604658 (+ 3687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.605451 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.605460 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.607128 (+ 1668us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.608287 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.608314 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.609661 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.609664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.611582 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.611597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.613006 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.613016 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.613396 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.614468 (+ 1072us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.614499 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.618318 (+ 3819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.623667 (+ 5349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.623676 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.623691 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.624777 (+ 1086us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.625399 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.625405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.625409 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.625734 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.626465 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.626473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.626898 (+ 425us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.627246 (+ 348us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.627735 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1206,"spinlock_wait_cycles":8576,"thread_start_us":764,"threads_started":1}
Aug 10 03:13:12 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.67@KRBTEST.COM
I20260810 03:13:12.630785 29799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.598572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:54637 (local address 127.18.112.126:33079)
0810 03:13:12.599539 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.599547 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.601183 (+ 1636us) server_negotiation.cc:407] Connection header received
0810 03:13:12.604984 (+ 3801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.604990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.605083 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.605188 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.608491 (+ 3303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.609518 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.611708 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.612704 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.612834 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.618509 (+ 5675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.618516 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.618530 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.618596 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.623508 (+ 4912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.624936 (+ 1428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.624941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.624945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.625244 (+ 299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.625893 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.625899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.625902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.626255 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.626395 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.629943 (+ 3548us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.630177 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":704,"threads_started":1}
I20260810 03:13:12.632283 29793 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:12.632660 29793 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.633916 29793 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:12.635752 28054 ts_manager.cc:194] Re-registered known tserver with Master: 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541)
I20260810 03:13:12.636860 28054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:54637
I20260810 03:13:12.639009 29803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.601127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.18.112.66:57063)
0810 03:13:12.603139 (+ 2012us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.603153 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.604674 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.605450 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.605461 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.612587 (+ 7126us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.615946 (+ 3359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.615959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.617612 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.617621 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.619844 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.619860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.624086 (+ 4226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.624097 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.624461 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.625185 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.625209 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.629266 (+ 4057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.635412 (+ 6146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.635417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.635421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.636058 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.636591 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.636598 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.636602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.636809 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.637744 (+ 935us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.637749 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.637903 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.638080 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.638366 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1866,"thread_start_us":1542,"threads_started":1}
I20260810 03:13:12.639045 29804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.601333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57063 (local address 127.18.112.124:45175)
0810 03:13:12.602234 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.602240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.603237 (+ 997us) server_negotiation.cc:407] Connection header received
0810 03:13:12.605033 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.605038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.605141 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.605248 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.616091 (+ 10843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.617455 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.620007 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.623728 (+ 3721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.624925 (+ 1197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.629534 (+ 4609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.629540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.629545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.629587 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.635239 (+ 5652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.636213 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.636218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.636221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.636444 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.636958 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.636963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.636966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.637553 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.637682 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.638266 (+ 584us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.638482 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":604,"threads_started":1}
I20260810 03:13:12.640179 29802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.600157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.18.112.66:52189)
0810 03:13:12.601177 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:12.601194 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:12.604971 (+ 3777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:12.607280 (+ 2309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:12.607285 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:12.607960 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:12.608575 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.608589 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.610657 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.610663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.612704 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:12.612718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.614438 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.614448 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:12.614722 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.618335 (+ 3613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:12.618355 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:12.624823 (+ 6468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:12.631943 (+ 7120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.631947 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.631950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.635028 (+ 3078us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.635567 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:12.635572 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:12.635575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:12.635891 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:12.636695 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:12.636700 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:12.636900 (+ 200us) client_negotiation.cc:769] Sending connection context
0810 03:13:12.637033 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 03:13:12.637350 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"spinlock_wait_cycles":35584,"thread_start_us":543,"threads_started":1}
I20260810 03:13:12.640408 29792 heartbeater.cc:347] Connected to a master server at 127.18.112.124:45175
I20260810 03:13:12.640545 29792 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.641149 29792 heartbeater.cc:511] Master 127.18.112.124:45175 requested a full tablet report, sending...
I20260810 03:13:12.641315 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.598524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52189 (local address 127.18.112.125:35539)
0810 03:13:12.599943 (+ 1419us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.599949 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.601281 (+ 1332us) server_negotiation.cc:407] Connection header received
0810 03:13:12.605134 (+ 3853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.605140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.606550 (+ 1410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.606729 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.608746 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.610423 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.612935 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.613575 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.613724 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.625067 (+ 11343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.625073 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.625079 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.625119 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.631778 (+ 6659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.635164 (+ 3386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.635169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.635171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.635410 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.636032 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.636037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.636039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.636473 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.636634 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.640557 (+ 3923us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.640764 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1293,"thread_start_us":1123,"threads_started":1}
I20260810 03:13:12.642163 29806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:12.606757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38418 (local address 127.18.112.67:35899)
0810 03:13:12.614856 (+ 8099us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:12.614862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:12.614885 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:13:12.614938 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:12.614943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:12.615196 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:12.615391 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:12.618167 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.620112 (+ 1945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.622029 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:12.622993 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:12.623125 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:12.632326 (+ 9201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:12.632343 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:12.632360 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:12.632408 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:12.637470 (+ 5062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.638638 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.638647 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.638651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.638813 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:12.639281 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:12.639286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:12.639289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:12.639651 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:12.640023 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:12.641332 (+ 1309us) server_negotiation.cc:299] Negotiation successful
0810 03:13:12.641598 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7916,"thread_start_us":7583,"threads_started":1}
I20260810 03:13:12.642479 29270 ts_manager.cc:194] Registered new tserver with Master: 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541)
I20260810 03:13:12.642848 29794 heartbeater.cc:347] Connected to a master server at 127.18.112.125:35539
I20260810 03:13:12.643021 29794 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:12.643668 29794 heartbeater.cc:511] Master 127.18.112.125:35539 requested a full tablet report, sending...
I20260810 03:13:12.644945 28984 ts_manager.cc:194] Registered new tserver with Master: 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541)
I20260810 03:13:12.645182 28755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:12.734292 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28571
I20260810 03:13:12.755720 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:35899
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:33079
--webserver_port=40113
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:13:13.064946 29557 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
W20260810 03:13:13.078635 29809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:13.078896 29809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:13.079034 29809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:13.086094 29809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:13.086199 29809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:13.086369 29809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:13.095530 29809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:35899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=40113
--tserver_master_addrs=127.18.112.126:33079,127.18.112.125:35539,127.18.112.124:45175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:13.096692 29809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:13.097908 29809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:13.111181 29818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:13.111218 29822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:13.111250 29819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:13.112082 29809 server_base.cc:1034] running on GCE node
I20260810 03:13:13.112668 29809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:13.113471 29809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:13.114658 29809 hybrid_clock.cc:648] HybridClock initialized: now 1786331593114605 us; error 44 us; skew 500 ppm
I20260810 03:13:13.114946 29809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:13 dist-test-slave-jlzn krb5kdc[27979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331593, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:13.118026 29809 init.cc:377] Logged in from keytab as oryx/127.18.112.67@KRBTEST.COM (short username oryx)
I20260810 03:13:13.119388 29809 webserver.cc:460] Webserver started at http://127.18.112.67:40113/ using document root <none> and password file <none>
I20260810 03:13:13.120090 29809 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:13.120224 29809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:13.125272 29809 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:13:13.127864 29832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:13.129076 29809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:13.129235 29809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "b6dcd17650d74dab94717ff1c4564d59"
format_stamp: "Formatted at 2026-08-10 03:13:09 on dist-test-slave-jlzn"
server_key: "96d7df5334f35bcf4dae396827e88493"
server_key_iv: "14d881a5f7d14f681906e84f1211fcfb"
server_key_version: "encryptionkey@0"
I20260810 03:13:13.130277 29809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:13.165329 29809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:13.169450 29809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:13.169708 29809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:13.170619 29809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:13.171953 29809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:13.172049 29809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:13.172158 29809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:13.172228 29809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:13.203598 29809 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:35899
I20260810 03:13:13.203675 30005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:35899 every 8 connection(s)
I20260810 03:13:13.205080 29809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:13.207060 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 29809
I20260810 03:13:13.259138 30030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.218107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60552 (local address 127.18.112.126:33079)
0810 03:13:13.230435 (+ 12328us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.230442 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.230463 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:13:13.230531 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.230537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.230617 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.233458 (+ 2841us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.233638 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.234789 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.236889 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.237602 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.238379 (+ 777us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.242551 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.242559 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.242574 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.242620 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.246722 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.247774 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.247780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.247784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.248007 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.248463 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.248469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.248472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.248858 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.256617 (+ 7759us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.256794 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.257045 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12184,"thread_start_us":12869,"threads_started":1}
Aug 10 03:13:13 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331593, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.125@KRBTEST.COM
I20260810 03:13:13.273339 30031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.218117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52982 (local address 127.18.112.125:35539)
0810 03:13:13.239051 (+ 20934us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.239058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.239077 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:13.239151 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.239157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.239238 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.241855 (+ 2617us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.242074 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.243230 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.254760 (+ 11530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.255676 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.255826 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.260139 (+ 4313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.260146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.260151 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.260196 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.268742 (+ 8546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.269752 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.269757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.269761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.270052 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.270625 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.270629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.270632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.271122 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.272444 (+ 1322us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.272574 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.272801 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20790,"thread_start_us":20692,"threads_started":1}
I20260810 03:13:13.274271 30035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.225738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.18.112.124:45175)
0810 03:13:13.232439 (+ 6701us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.232443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.250100 (+ 17657us) server_negotiation.cc:407] Connection header received
0810 03:13:13.250333 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.250339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.250427 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.250507 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.255729 (+ 5222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.257386 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.259876 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.260761 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.260860 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.266311 (+ 5451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.266318 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.266323 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.266365 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.270502 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.271245 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.271250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.271253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.271449 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.272010 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.272015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.272017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.272581 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.272814 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.273534 (+ 720us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.273786 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6597,"thread_start_us":6452,"threads_started":1}
Aug 10 03:13:13 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331593, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:13.265769 28054 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
Aug 10 03:13:13 dist-test-slave-jlzn krb5kdc[27979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331593, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.124@KRBTEST.COM
W20260810 03:13:13.283568 28054 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:13.286331 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.208474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:50143 (local address 127.18.112.125:35539)
0810 03:13:13.235251 (+ 26777us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.235257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.239369 (+ 4112us) server_negotiation.cc:407] Connection header received
0810 03:13:13.239407 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.239412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.239463 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.239549 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.255610 (+ 16061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.261643 (+ 6033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.265886 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.267029 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.267146 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.272768 (+ 5622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.272776 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.272781 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.272817 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.277591 (+ 4774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.278737 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.278742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.278744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.278981 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.279593 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.279598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.279600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.280689 (+ 1089us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.280879 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.285427 (+ 4548us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.285672 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26636,"thread_start_us":41625,"threads_started":1}
I20260810 03:13:13.286389 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.208792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.18.112.67:50143)
0810 03:13:13.235866 (+ 27074us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.235929 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.238329 (+ 2400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.252383 (+ 14054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.252387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.253354 (+ 967us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:13.255318 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.255348 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.262124 (+ 6776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.262130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.265708 (+ 3578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.265725 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.267542 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.267552 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.267980 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.268879 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:13.268909 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:13.272437 (+ 3528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:13.277771 (+ 5334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.277780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.277801 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.278535 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.279124 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.279128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.279132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.279455 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.280963 (+ 1508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:13.280970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:13.283563 (+ 2593us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.283910 (+ 347us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.284546 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26740,"thread_start_us":26506,"threads_started":1}
I20260810 03:13:13.288470 30012 heartbeater.cc:347] Connected to a master server at 127.18.112.125:35539
I20260810 03:13:13.288807 30012 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:13.289860 30012 heartbeater.cc:511] Master 127.18.112.125:35539 requested a full tablet report, sending...
I20260810 03:13:13.290905 30042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.244208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41323 (local address 127.18.112.126:33079)
0810 03:13:13.251472 (+ 7264us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.251477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.251510 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:13:13.251555 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.251559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.251624 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.251727 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.257693 (+ 5966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.258863 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.264149 (+ 5286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.264868 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.264981 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.281323 (+ 16342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.281330 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.281334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.281372 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.286760 (+ 5388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.287930 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.287935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.287939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.288094 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.288682 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.288688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.288691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.289132 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.289265 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.289935 (+ 670us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.290203 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7144,"thread_start_us":10429,"threads_started":1}
I20260810 03:13:13.292019 28984 ts_manager.cc:194] Registered new tserver with Master: b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
I20260810 03:13:13.292150 30039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.244093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:41323)
0810 03:13:13.250581 (+ 6488us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.250599 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.250728 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.252269 (+ 1541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.252274 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.254315 (+ 2041us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:13.257528 (+ 3213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.257545 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.259849 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.259854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.264011 (+ 4157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.264026 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.275689 (+ 11663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.275697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.275916 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.277592 (+ 1676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:13.277612 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:13.281093 (+ 3481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:13.286910 (+ 5817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.286915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.286918 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.287751 (+ 833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.288261 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.288265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.288268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.288458 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.289350 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:13.289355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:13.289597 (+ 242us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.291094 (+ 1497us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.291362 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6368,"thread_start_us":6701,"threads_started":1}
I20260810 03:13:13.292662 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.208142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:53797 (local address 127.18.112.124:45175)
0810 03:13:13.209283 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.209289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.243986 (+ 34697us) server_negotiation.cc:407] Connection header received
0810 03:13:13.251140 (+ 7154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.251146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.251261 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.251363 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.258097 (+ 6734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.259639 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.277355 (+ 17716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.278387 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.278501 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.285038 (+ 6537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.285048 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.285053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.285089 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.289310 (+ 4221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.290129 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.290134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.290138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.290360 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.290992 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.290997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.291000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.291316 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.291450 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.292045 (+ 595us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.292252 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":998,"thread_start_us":869,"threads_started":1}
I20260810 03:13:13.293177 30011 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33079
I20260810 03:13:13.293437 30011 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:13.293656 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.209444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.18.112.67:53797)
0810 03:13:13.243890 (+ 34446us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.243907 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.251012 (+ 7105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.251904 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.251917 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.256598 (+ 4681us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:13.257914 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.257928 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.260067 (+ 2139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.260072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.277222 (+ 17150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.277235 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.278886 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.278894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.279213 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.279983 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:13.280007 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:13.284720 (+ 4713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:13.289439 (+ 4719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.289443 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.289447 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.289992 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.290515 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:13.290520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:13.290523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:13.290846 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:13.291546 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:13.291550 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:13.291730 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.292880 (+ 1150us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.293151 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34291,"thread_start_us":34121,"threads_started":1}
I20260810 03:13:13.294279 30011 heartbeater.cc:511] Master 127.18.112.126:33079 requested a full tablet report, sending...
I20260810 03:13:13.294551 30010 heartbeater.cc:347] Connected to a master server at 127.18.112.124:45175
I20260810 03:13:13.294704 30010 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:13.295265 30010 heartbeater.cc:511] Master 127.18.112.124:45175 requested a full tablet report, sending...
I20260810 03:13:13.296604 28053 ts_manager.cc:194] Re-registered known tserver with Master: b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
I20260810 03:13:13.296816 29270 ts_manager.cc:194] Registered new tserver with Master: b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
I20260810 03:13:13.299893 28053 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:41323
I20260810 03:13:13.338569 30057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.321592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34541 (local address 127.0.0.1:56972)
0810 03:13:13.322875 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.322896 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.323067 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.324262 (+ 1195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.324268 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.324299 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:13.327157 (+ 2858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.327173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.329200 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.329206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.332994 (+ 3788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.333016 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.337536 (+ 4520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.337544 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.337801 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.337830 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.337914 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.338057 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":1244,"threads_started":1}
I20260810 03:13:13.338559 30060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.322670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56972 (local address 127.18.112.66:34541)
0810 03:13:13.323478 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.323486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.323517 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:13:13.323622 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.323631 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.323952 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.324287 (+ 335us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:13.327379 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.329012 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.333244 (+ 4232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.336795 (+ 3551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.336968 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.337251 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.337985 (+ 734us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.338222 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":501,"threads_started":1}
I20260810 03:13:13.339187 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.322045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:38421 (local address 127.0.0.1:41042)
0810 03:13:13.326468 (+ 4423us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.326488 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.326652 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.327742 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.327747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.327774 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:13.328799 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.328815 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.331780 (+ 2965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.331787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.335208 (+ 3421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.335226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.337989 (+ 2763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.337997 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.338341 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.338378 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.338461 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.338600 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4233,"thread_start_us":3965,"threads_started":1}
I20260810 03:13:13.340378 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.322434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41042 (local address 127.18.112.65:38421)
0810 03:13:13.325854 (+ 3420us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.325862 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.326799 (+ 937us) server_negotiation.cc:407] Connection header received
0810 03:13:13.326905 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.326912 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.327166 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.327397 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:13.329143 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.331560 (+ 2417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.335395 (+ 3835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.337291 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.337461 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.337706 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.339602 (+ 1896us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.339819 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3170,"thread_start_us":3005,"threads_started":1}
I20260810 03:13:13.343611 29692 tablet_service.cc:1467] Processing CreateTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 (DEFAULT_TABLE table=test-table [id=0b293d938c594073a65c1340fbd2348b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:13.345219 29692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c205f534a74baabd1c1b3b8d8f0b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:13.345461 29455 tablet_service.cc:1467] Processing CreateTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 (DEFAULT_TABLE table=test-table [id=0b293d938c594073a65c1340fbd2348b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:13.346788 29455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c205f534a74baabd1c1b3b8d8f0b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:13.352654 30063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.328944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38426 (local address 127.18.112.67:35899)
0810 03:13:13.341355 (+ 12411us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.341361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.341387 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:13.341457 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.341462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.341612 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.341792 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:13.342720 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.345172 (+ 2452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.348999 (+ 3827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.350993 (+ 1994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.351130 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.351367 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.351874 (+ 507us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.352078 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12242,"thread_start_us":11778,"threads_started":1}
I20260810 03:13:13.353551 30061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.326855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:35899 (local address 127.0.0.1:38426)
0810 03:13:13.337293 (+ 10438us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.337310 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.337467 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.341824 (+ 4357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.341829 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.341855 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:13.342501 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.342518 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.345595 (+ 3077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.345599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.348782 (+ 3183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.348798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.351358 (+ 2560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.351367 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.351653 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.351690 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.351832 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.351966 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10266,"thread_start_us":10691,"threads_started":1}
I20260810 03:13:13.358062 29918 tablet_service.cc:1467] Processing CreateTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 (DEFAULT_TABLE table=test-table [id=0b293d938c594073a65c1340fbd2348b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:13.359848 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c205f534a74baabd1c1b3b8d8f0b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:13.363373 30065 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Bootstrap starting.
I20260810 03:13:13.365069 30068 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Bootstrap starting.
I20260810 03:13:13.368894 30065 tablet_bootstrap.cc:654] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:13.369889 30068 tablet_bootstrap.cc:654] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:13.370839 30065 log.cc:824] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:13.372282 30068 log.cc:824] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:13.375145 30065 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: No bootstrap required, opened a new log
I20260810 03:13:13.375425 30065 ts_tablet_manager.cc:1397] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260810 03:13:13.376155 30068 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: No bootstrap required, opened a new log
I20260810 03:13:13.376572 30068 ts_tablet_manager.cc:1397] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260810 03:13:13.377110 30074 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Bootstrap starting.
I20260810 03:13:13.382575 30074 tablet_bootstrap.cc:654] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:13.384701 30074 log.cc:824] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:13.387651 30065 raft_consensus.cc:348] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.388128 30065 raft_consensus.cc:374] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:13.388236 30065 raft_consensus.cc:729] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a9a2c992664c778eb5515a7184efe2, State: Initialized, Role: FOLLOWER
I20260810 03:13:13.389074 30074 tablet_bootstrap.cc:492] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: No bootstrap required, opened a new log
I20260810 03:13:13.388895 30065 consensus_queue.cc:260] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.389447 30074 ts_tablet_manager.cc:1397] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.009s
I20260810 03:13:13.391047 30065 ts_tablet_manager.cc:1428] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260810 03:13:13.390944 30068 raft_consensus.cc:348] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.391600 30068 raft_consensus.cc:374] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:13.391726 30068 raft_consensus.cc:729] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb3949f331847e1bdde6cffaf7cc115, State: Initialized, Role: FOLLOWER
I20260810 03:13:13.392378 30068 consensus_queue.cc:260] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.397892 30068 ts_tablet_manager.cc:1428] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Time spent starting tablet: real 0.021s user 0.017s sys 0.003s
I20260810 03:13:13.398537 29793 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
I20260810 03:13:13.406322 30074 raft_consensus.cc:348] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.406804 30074 raft_consensus.cc:374] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:13.406972 30074 raft_consensus.cc:729] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dcd17650d74dab94717ff1c4564d59, State: Initialized, Role: FOLLOWER
I20260810 03:13:13.407634 30074 consensus_queue.cc:260] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.409262 30011 heartbeater.cc:503] Master 127.18.112.126:33079 was elected leader, sending a full tablet report...
I20260810 03:13:13.409804 30074 ts_tablet_manager.cc:1428] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Time spent starting tablet: real 0.020s user 0.013s sys 0.004s
W20260810 03:13:13.463732 30016 tablet.cc:2369] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:13:13.496942 30077 raft_consensus.cc:482] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:13.497453 30077 raft_consensus.cc:504] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.499711 30077 leader_election.cc:288] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421), b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
W20260810 03:13:13.502538 29559 tablet.cc:2369] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:13:13.509563 30063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.501752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:59159 (local address 127.18.112.67:35899)
0810 03:13:13.501963 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.501968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.502205 (+ 237us) server_negotiation.cc:407] Connection header received
0810 03:13:13.502385 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.502390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.502475 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.502582 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:13.503575 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.504995 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.507650 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.508524 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.508647 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.508709 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.509143 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.509289 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:13:13.509745 30080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.501174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:35899 (local address 127.18.112.66:59159)
0810 03:13:13.502114 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.502130 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.502248 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.502612 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.502617 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.502643 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:13.503314 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.503327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.505125 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.505135 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.507499 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.507514 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.508786 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.508793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.508970 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.509006 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.509092 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.509235 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":1,"thread_start_us":683,"threads_started":1}
I20260810 03:13:13.510233 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.500049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:55771 (local address 127.18.112.65:38421)
0810 03:13:13.500233 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.500238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.501370 (+ 1132us) server_negotiation.cc:407] Connection header received
0810 03:13:13.501669 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.501676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.501776 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.501850 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:13.503224 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.504371 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.507508 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.508949 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.509099 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.509164 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.509792 (+ 628us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.509919 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 03:13:13.511188 30079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.500159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:38421 (local address 127.18.112.66:55771)
0810 03:13:13.501266 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:13.501282 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:13.501469 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:13.502144 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:13.502150 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:13.502179 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:13.503063 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.503080 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.504537 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.504542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.507298 (+ 2756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:13.507311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.509309 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.509317 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:13.509570 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.509605 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 03:13:13.510397 (+ 792us) client_negotiation.cc:240] Negotiation successful
0810 03:13:13.510520 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"mutex_wait_us":38,"thread_start_us":600,"threads_started":1}
I20260810 03:13:13.511260 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c205f534a74baabd1c1b3b8d8f0b54" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dcd17650d74dab94717ff1c4564d59" is_pre_election: true
I20260810 03:13:13.512157 29942 raft_consensus.cc:2454] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 0.
I20260810 03:13:13.513200 29610 leader_election.cc:302] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb3949f331847e1bdde6cffaf7cc115, b6dcd17650d74dab94717ff1c4564d59; no voters:
I20260810 03:13:13.513703 30077 raft_consensus.cc:2781] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:13.513823 30077 raft_consensus.cc:482] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:13.513924 30077 raft_consensus.cc:3037] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:13.513708 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c205f534a74baabd1c1b3b8d8f0b54" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a9a2c992664c778eb5515a7184efe2" is_pre_election: true
I20260810 03:13:13.514505 29483 raft_consensus.cc:2454] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 0.
I20260810 03:13:13.517402 30077 raft_consensus.cc:504] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.518016 30077 leader_election.cc:288] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 election: Requested vote from peers a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421), b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899)
I20260810 03:13:13.518440 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c205f534a74baabd1c1b3b8d8f0b54" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a9a2c992664c778eb5515a7184efe2"
I20260810 03:13:13.518674 29483 raft_consensus.cc:3037] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:13.518671 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7c205f534a74baabd1c1b3b8d8f0b54" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dcd17650d74dab94717ff1c4564d59"
I20260810 03:13:13.518918 29942 raft_consensus.cc:3037] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:13.522017 29483 raft_consensus.cc:2454] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 1.
I20260810 03:13:13.522430 29610 leader_election.cc:302] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb3949f331847e1bdde6cffaf7cc115, a8a9a2c992664c778eb5515a7184efe2; no voters:
I20260810 03:13:13.522697 29942 raft_consensus.cc:2454] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 1.
I20260810 03:13:13.522822 30077 raft_consensus.cc:2781] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:13.523561 30077 raft_consensus.cc:686] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb3949f331847e1bdde6cffaf7cc115, State: Running, Role: LEADER
I20260810 03:13:13.524273 30077 consensus_queue.cc:237] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } }
I20260810 03:13:13.530368 28053 catalog_manager.cc:5495] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66). New cstate: current_term: 1 leader_uuid: "3cb3949f331847e1bdde6cffaf7cc115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } health_report { overall_health: UNKNOWN } } }
I20260810 03:13:13.572978 30060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.565548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56986 (local address 127.18.112.66:34541)
0810 03:13:13.565794 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.565801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.565944 (+ 143us) server_negotiation.cc:407] Connection header received
0810 03:13:13.566150 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.566154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.566297 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.566431 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:13.567022 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.568278 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.570359 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.571029 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.571142 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.571632 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:13.572249 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:13.572388 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.572485 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.572568 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:13:13.583094 29942 raft_consensus.cc:1261] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Refusing update from remote peer 3cb3949f331847e1bdde6cffaf7cc115: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:13.583164 29483 raft_consensus.cc:1261] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Refusing update from remote peer 3cb3949f331847e1bdde6cffaf7cc115: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:13.584169 30081 consensus_queue.cc:1035] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:13.584743 30077 consensus_queue.cc:1035] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:13:13.599128 29796 tablet.cc:2369] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:13:13.600976 30087 mvcc.cc:205] Tried to move back new op lower bound from 7316814207305588736 to 7316814207080075264. Current Snapshot: MvccSnapshot[applied={T|T < 7316814207305588736}]
I20260810 03:13:13.632704 28053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:13.633097 28053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:13.640285 28053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62cd9d90c58d4f69b807c5b387c8c19f: Sending DeleteTablet for 3 replicas of tablet d7c205f534a74baabd1c1b3b8d8f0b54
I20260810 03:13:13.641532 29455 tablet_service.cc:1514] Processing DeleteTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:13 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:41042
I20260810 03:13:13.641582 29918 tablet_service.cc:1514] Processing DeleteTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:13 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38426
I20260810 03:13:13.642591 30102 tablet_replica.cc:330] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: stopping tablet replica
I20260810 03:13:13.642966 29692 tablet_service.cc:1514] Processing DeleteTablet for tablet d7c205f534a74baabd1c1b3b8d8f0b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:13 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:56972
I20260810 03:13:13.643033 30102 raft_consensus.cc:2229] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:13.643625 30102 raft_consensus.cc:2258] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:13.644747 30105 tablet_replica.cc:330] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: stopping tablet replica
I20260810 03:13:13.645267 30105 raft_consensus.cc:2229] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:13.645874 30102 ts_tablet_manager.cc:1905] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:13.646378 30105 raft_consensus.cc:2258] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:13.649602 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28000
I20260810 03:13:13.650790 28104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:13.654454 30105 ts_tablet_manager.cc:1905] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:13.654812 30102 ts_tablet_manager.cc:1918] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:13.655103 30102 log.cc:1196] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/d7c205f534a74baabd1c1b3b8d8f0b54
I20260810 03:13:13.655947 30102 ts_tablet_manager.cc:1939] T d7c205f534a74baabd1c1b3b8d8f0b54 P b6dcd17650d74dab94717ff1c4564d59: Deleting consensus metadata
I20260810 03:13:13.662545 30103 tablet_replica.cc:330] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: stopping tablet replica
I20260810 03:13:13.665409 30105 ts_tablet_manager.cc:1918] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:13.665560 30105 log.cc:1196] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/d7c205f534a74baabd1c1b3b8d8f0b54
I20260810 03:13:13.666173 30105 ts_tablet_manager.cc:1939] T d7c205f534a74baabd1c1b3b8d8f0b54 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting consensus metadata
I20260810 03:13:13.667488 30103 raft_consensus.cc:2229] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:13.668272 30103 raft_consensus.cc:2258] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:13.670351 30103 ts_tablet_manager.cc:1905] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:13.680161 30103 ts_tablet_manager.cc:1918] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:13.680423 30103 log.cc:1196] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/d7c205f534a74baabd1c1b3b8d8f0b54
I20260810 03:13:13.681504 30103 ts_tablet_manager.cc:1939] T d7c205f534a74baabd1c1b3b8d8f0b54 P a8a9a2c992664c778eb5515a7184efe2: Deleting consensus metadata
I20260810 03:13:13.683604 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.647935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52992 (local address 127.18.112.125:35539)
0810 03:13:13.648129 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.648135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.648966 (+ 831us) server_negotiation.cc:407] Connection header received
0810 03:13:13.649044 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.649050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.649177 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.649283 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.652871 (+ 3588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.654381 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.661653 (+ 7272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.662741 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.662951 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.667453 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.667462 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.667467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.667508 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.671986 (+ 4478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.672861 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.672866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.672870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.673017 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.673547 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.673552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.673556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.674104 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.682810 (+ 8706us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.682968 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.683221 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:13:13.700428 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.649505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53562 (local address 127.18.112.124:45175)
0810 03:13:13.649672 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.649677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.675468 (+ 25791us) server_negotiation.cc:407] Connection header received
0810 03:13:13.675763 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.675769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.675892 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.675970 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.678479 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.680036 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.685264 (+ 5228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.686202 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.686313 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.691372 (+ 5059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.691378 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.691383 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.691423 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.696636 (+ 5213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.697526 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.697532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.697536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.697750 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.698365 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.698370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.698374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.698870 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.699157 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.699602 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.699918 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:13:13.794754 28031 catalog_manager.cc:4841] TS 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541): tablet d7c205f534a74baabd1c1b3b8d8f0b54 (table test-table [id=0b293d938c594073a65c1340fbd2348b]) successfully deleted
I20260810 03:13:13.795481 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28000
W20260810 03:13:13.822270 29381 connection.cc:535] server connection from 127.0.0.1:41042 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 03:13:13.843326 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.827145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53000 (local address 127.18.112.125:35539)
0810 03:13:13.827333 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.827339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.828359 (+ 1020us) server_negotiation.cc:407] Connection header received
0810 03:13:13.828607 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.828613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.828692 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.828767 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.830821 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.831636 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.833330 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.833819 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.833936 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.837316 (+ 3380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.837321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.837324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.837365 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.840234 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.841079 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.841085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.841088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.841213 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.841627 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.841633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.841636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.842003 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.842280 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.842879 (+ 599us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.843097 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:13:13.845698 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:13.828673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53564 (local address 127.18.112.124:45175)
0810 03:13:13.828868 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:13.828873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:13.828964 (+ 91us) server_negotiation.cc:407] Connection header received
0810 03:13:13.829147 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:13.829152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:13.829236 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:13.829327 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:13.831865 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.832911 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.835312 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:13.835978 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:13.836128 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:13.839181 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:13.839187 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:13.839193 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:13.839233 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:13.842792 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.843679 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.843685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.843689 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.843876 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:13.844291 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:13.844296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:13.844299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:13.844663 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:13.845102 (+ 439us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:13.845246 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 03:13:13.845412 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:13:14.609910 30122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:14.609229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:37961)
0810 03:13:14.609640 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:14.609759 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":201,"threads_started":1}
W20260810 03:13:14.610296 29557 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:33079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:14.617781 30123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:14.616941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:59177)
0810 03:13:14.617368 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:14.617554 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":196,"threads_started":1}
W20260810 03:13:14.618165 30011 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:33079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:14.624449 30126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:14.623623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:42745)
0810 03:13:14.624126 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:14.624262 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":239,"threads_started":1}
W20260810 03:13:14.624835 29793 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:33079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:15.140914 30127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62cd9d90c58d4f69b807c5b387c8c19f)
I20260810 03:13:15.140998 30128 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62cd9d90c58d4f69b807c5b387c8c19f)
I20260810 03:13:15.141119 30127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } }
I20260810 03:13:15.141280 30128 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } }
I20260810 03:13:15.142052 30127 leader_election.cc:288] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079), d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125:35539)
I20260810 03:13:15.142797 30128 leader_election.cc:288] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079), 414a790f150e479689c880eadb55caef (127.18.112.124:45175)
I20260810 03:13:15.143469 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.142196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32790)
0810 03:13:15.142779 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.143098 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":385,"threads_started":1}
W20260810 03:13:15.143726 29247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:15.145275 30135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.144347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32804)
0810 03:13:15.144802 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.144972 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":284,"threads_started":1}
I20260810 03:13:15.145933 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.145320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32814)
0810 03:13:15.145703 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.145787 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272}
W20260810 03:13:15.145946 28962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
W20260810 03:13:15.146150 29247 leader_election.cc:334] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079): Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:15.150270 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.142304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:35539 (local address 127.0.0.1:53008)
0810 03:13:15.143349 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.143367 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:15.143483 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:15.144210 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:15.144215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:15.144246 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:15.144605 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.144621 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.146312 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.146317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.147972 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.147984 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.149525 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.149531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.149720 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.149758 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:13:15.149847 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:13:15.149964 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"thread_start_us":781,"threads_started":1}
I20260810 03:13:15.150480 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.142433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53008 (local address 127.18.112.125:35539)
0810 03:13:15.143919 (+ 1486us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.143925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.143944 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:15.144005 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.144009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.144075 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.144170 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:15.144833 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.146126 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.148145 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.149359 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.149518 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.149590 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.149968 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.150114 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":1348,"thread_start_us":1621,"threads_started":1}
I20260810 03:13:15.151285 30137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.150773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32828)
0810 03:13:15.150935 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.151086 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:13:15.151314 28997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "414a790f150e479689c880eadb55caef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6b1c90f841d45e8a98f3c46dd152448" is_pre_election: true
W20260810 03:13:15.151466 28962 leader_election.cc:334] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079): Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:15.151615 28997 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414a790f150e479689c880eadb55caef in term 1.
I20260810 03:13:15.152088 29250 leader_election.cc:302] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 414a790f150e479689c880eadb55caef, d6b1c90f841d45e8a98f3c46dd152448; no voters: 62cd9d90c58d4f69b807c5b387c8c19f
I20260810 03:13:15.152532 30135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.145009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:45175 (local address 127.0.0.1:53570)
0810 03:13:15.145473 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.145490 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:15.145601 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:15.146480 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:15.146486 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:15.146527 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:15.146782 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.146793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.148499 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.148504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.150539 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.150556 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.151891 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.151896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.152097 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.152121 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:13:15.152202 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:13:15.152334 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":23,"thread_start_us":679,"threads_started":1}
I20260810 03:13:15.152495 30127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 03:13:15.152631 30127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62cd9d90c58d4f69b807c5b387c8c19f)
I20260810 03:13:15.152751 30127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:13:15.152768 30138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.145470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53570 (local address 127.18.112.124:45175)
0810 03:13:15.145977 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.146063 (+ 86us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.146089 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:15.146200 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.146206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.146276 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.146452 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:15.146946 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.148338 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.150708 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.151693 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.151866 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.151930 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.152254 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.152375 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":563,"threads_started":1}
I20260810 03:13:15.153285 29287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6b1c90f841d45e8a98f3c46dd152448" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "414a790f150e479689c880eadb55caef" is_pre_election: true
I20260810 03:13:15.155007 30127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } }
I20260810 03:13:15.155405 29287 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b1c90f841d45e8a98f3c46dd152448 in current term 2: Already voted for candidate 414a790f150e479689c880eadb55caef in this term.
I20260810 03:13:15.155650 30127 leader_election.cc:288] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 election: Requested vote from peers 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079), d6b1c90f841d45e8a98f3c46dd152448 (127.18.112.125:35539)
I20260810 03:13:15.156137 28997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "414a790f150e479689c880eadb55caef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6b1c90f841d45e8a98f3c46dd152448"
I20260810 03:13:15.156302 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.155656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32830)
0810 03:13:15.156081 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.156175 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327}
I20260810 03:13:15.156338 28997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:13:15.156898 28962 leader_election.cc:302] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b1c90f841d45e8a98f3c46dd152448; no voters: 414a790f150e479689c880eadb55caef, 62cd9d90c58d4f69b807c5b387c8c19f
I20260810 03:13:15.157279 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.156907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32838)
0810 03:13:15.157055 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.157144 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 03:13:15.157469 29247 leader_election.cc:334] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079): Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
I20260810 03:13:15.158694 28997 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414a790f150e479689c880eadb55caef in term 2.
I20260810 03:13:15.158864 30128 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:13:15.159057 29250 leader_election.cc:302] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 414a790f150e479689c880eadb55caef, d6b1c90f841d45e8a98f3c46dd152448; no voters: 62cd9d90c58d4f69b807c5b387c8c19f
I20260810 03:13:15.159323 30127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:13:15.159696 30127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [term 2 LEADER]: Becoming Leader. State: Replica: 414a790f150e479689c880eadb55caef, State: Running, Role: LEADER
I20260810 03:13:15.160049 30127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } }
I20260810 03:13:15.161885 30143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 414a790f150e479689c880eadb55caef. Latest consensus state: current_term: 2 leader_uuid: "414a790f150e479689c880eadb55caef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:15.162278 30143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:15.163002 30146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:15.166926 30146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:15.167722 30146 catalog_manager.cc:1259] Loaded cluster ID: b3f0eeeb65fc4075bd93f7c37a77081a
I20260810 03:13:15.167797 30146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:15.168905 30146 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:15.169695 30146 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Loaded TSK: 0
I20260810 03:13:15.170446 30146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:13:15.224090 29270 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:15.231199 29270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:15.235023 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.234624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32872)
0810 03:13:15.234787 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.234880 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:13:15.235206 28997 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [term 2 FOLLOWER]: Refusing update from remote peer 414a790f150e479689c880eadb55caef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 03:13:15.236023 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.235602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32878)
0810 03:13:15.235780 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.235884 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 03:13:15.235961 30143 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260810 03:13:15.236212 29247 consensus_peers.cc:487] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef -> Peer 62cd9d90c58d4f69b807c5b387c8c19f (127.18.112.126:33079): Couldn't send request to peer 62cd9d90c58d4f69b807c5b387c8c19f. Status: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 03:13:15.238379 30128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 414a790f150e479689c880eadb55caef. Latest consensus state: current_term: 2 leader_uuid: "414a790f150e479689c880eadb55caef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:15.238606 30128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:15.240265 30143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "414a790f150e479689c880eadb55caef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:15.240548 30143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:15.240759 30128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "414a790f150e479689c880eadb55caef" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "62cd9d90c58d4f69b807c5b387c8c19f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33079 } } peers { permanent_uuid: "d6b1c90f841d45e8a98f3c46dd152448" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 35539 } attrs { promote: false } } peers { permanent_uuid: "414a790f150e479689c880eadb55caef" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 45175 } attrs { promote: false } } }
I20260810 03:13:15.241014 30128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b1c90f841d45e8a98f3c46dd152448 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:13:15.241542 30148 mvcc.cc:205] Tried to move back new op lower bound from 7316814214077296640 to 7316814213778989056. Current Snapshot: MvccSnapshot[applied={T|T < 7316814214077296640 or (T in {7316814214077296640})}]
I20260810 03:13:15.254727 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.247610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:35899 (local address 127.0.0.1:38436)
0810 03:13:15.247961 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.247979 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:15.248083 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:15.248472 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:15.248476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:15.248501 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:15.248707 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.248719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.250383 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.250389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.252341 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.252358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.254001 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.254007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.254250 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.254290 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:13:15.254355 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 03:13:15.254475 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245}
I20260810 03:13:15.255860 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.247691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38436 (local address 127.18.112.67:35899)
0810 03:13:15.248111 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.248116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.248150 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:13:15.248232 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.248237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.248321 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.248846 (+ 525us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:15.249031 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.250207 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.252568 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.253823 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.255193 (+ 1370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.255326 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.255385 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.255533 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":784,"threads_started":1}
I20260810 03:13:15.258049 29918 tablet_service.cc:1467] Processing CreateTablet for tablet 1719a3de3f1c4c26a352f6894a443275 (DEFAULT_TABLE table=test-table [id=a294377582bc4cf8bf1c49cc5555b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:15.258576 29918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1719a3de3f1c4c26a352f6894a443275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:15.264119 30158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.249168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.18.112.65:38421)
0810 03:13:15.258601 (+ 9433us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.258607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.258624 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:13:15.258782 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.258786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.258842 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.258930 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:15.259348 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.260414 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.262421 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.263159 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.263267 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.263370 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.263677 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.263843 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9312,"thread_start_us":9214,"threads_started":1}
I20260810 03:13:15.264138 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.248772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:38421 (local address 127.0.0.1:41046)
0810 03:13:15.254912 (+ 6140us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.254929 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:15.255027 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:15.258972 (+ 3945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:15.258976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:15.259000 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:15.259186 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.259197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.260538 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.260544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.262279 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.262294 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.263318 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.263324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.263534 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.263558 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:13:15.263646 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 03:13:15.263768 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6058,"mutex_wait_us":1,"thread_start_us":8360,"threads_started":1}
I20260810 03:13:15.265256 29455 tablet_service.cc:1467] Processing CreateTablet for tablet 1719a3de3f1c4c26a352f6894a443275 (DEFAULT_TABLE table=test-table [id=a294377582bc4cf8bf1c49cc5555b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:15.265664 29455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1719a3de3f1c4c26a352f6894a443275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:15.266933 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.248002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34541 (local address 127.0.0.1:56992)
0810 03:13:15.248129 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.248147 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:15.248261 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:15.258290 (+ 10029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:15.258294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:15.258322 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:15.258573 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.258583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.260471 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.260476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.264298 (+ 3822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:15.264312 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.266315 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.266322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:15.266463 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.266485 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:13:15.266560 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 03:13:15.266683 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":1828}
I20260810 03:13:15.267006 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.248399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.18.112.66:34541)
0810 03:13:15.258014 (+ 9615us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.258019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.258034 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:13:15.258090 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.258094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.258151 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.259078 (+ 927us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:15.259246 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.260305 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.264934 (+ 4629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.266112 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.266234 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.266336 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.266600 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.266745 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9515,"thread_start_us":9401,"threads_started":1}
I20260810 03:13:15.267720 29692 tablet_service.cc:1467] Processing CreateTablet for tablet 1719a3de3f1c4c26a352f6894a443275 (DEFAULT_TABLE table=test-table [id=a294377582bc4cf8bf1c49cc5555b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:15.268002 30159 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Bootstrap starting.
I20260810 03:13:15.268177 29692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1719a3de3f1c4c26a352f6894a443275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:15.269372 30159 tablet_bootstrap.cc:654] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:15.271611 30159 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: No bootstrap required, opened a new log
I20260810 03:13:15.271751 30159 ts_tablet_manager.cc:1397] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 03:13:15.272382 30159 raft_consensus.cc:348] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.272560 30159 raft_consensus.cc:374] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:15.272656 30159 raft_consensus.cc:729] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dcd17650d74dab94717ff1c4564d59, State: Initialized, Role: FOLLOWER
I20260810 03:13:15.272887 30159 consensus_queue.cc:260] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.276170 30159 ts_tablet_manager.cc:1428] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 03:13:15.281016 30161 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Bootstrap starting.
I20260810 03:13:15.281601 30165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.273893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:58647)
0810 03:13:15.280230 (+ 6337us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.280362 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6195,"thread_start_us":6095,"threads_started":1}
I20260810 03:13:15.282191 30169 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Bootstrap starting.
I20260810 03:13:15.282766 30161 tablet_bootstrap.cc:654] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:15.282766 30010 heartbeater.cc:503] Master 127.18.112.124:45175 was elected leader, sending a full tablet report...
I20260810 03:13:15.283342 30165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.282907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:54359)
0810 03:13:15.283115 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.283208 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 03:13:15.284586 30169 tablet_bootstrap.cc:654] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:15.284866 30161 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: No bootstrap required, opened a new log
I20260810 03:13:15.284996 30161 ts_tablet_manager.cc:1397] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 03:13:15.285687 30161 raft_consensus.cc:348] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.285912 30161 raft_consensus.cc:374] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:15.286010 30161 raft_consensus.cc:729] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a9a2c992664c778eb5515a7184efe2, State: Initialized, Role: FOLLOWER
I20260810 03:13:15.286435 30169 tablet_bootstrap.cc:492] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: No bootstrap required, opened a new log
I20260810 03:13:15.286561 30169 ts_tablet_manager.cc:1397] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 03:13:15.286266 30161 consensus_queue.cc:260] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.287283 30169 raft_consensus.cc:348] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.287472 30169 raft_consensus.cc:374] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:15.287585 30169 raft_consensus.cc:729] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb3949f331847e1bdde6cffaf7cc115, State: Initialized, Role: FOLLOWER
I20260810 03:13:15.287797 30169 consensus_queue.cc:260] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.288288 30161 ts_tablet_manager.cc:1428] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 03:13:15.288635 30169 ts_tablet_manager.cc:1428] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:15.291230 30178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.289163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:45365)
0810 03:13:15.290797 (+ 1634us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.290996 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1508,"thread_start_us":1370,"threads_started":1}
I20260810 03:13:15.292536 30177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.288805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:36929)
0810 03:13:15.291875 (+ 3070us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.292174 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2925,"thread_start_us":3095,"threads_started":1}
I20260810 03:13:15.293573 29556 heartbeater.cc:503] Master 127.18.112.124:45175 was elected leader, sending a full tablet report...
I20260810 03:13:15.294109 29792 heartbeater.cc:503] Master 127.18.112.124:45175 was elected leader, sending a full tablet report...
I20260810 03:13:15.294734 30180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.291770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:52413)
0810 03:13:15.293991 (+ 2221us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.294446 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2106,"thread_start_us":1960,"threads_started":1}
I20260810 03:13:15.293578 30177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.293206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:40801)
0810 03:13:15.293358 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.293438 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 03:13:15.313498 30176 raft_consensus.cc:482] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:15.313652 30176 raft_consensus.cc:504] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.314213 30176 leader_election.cc:288] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899), a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
I20260810 03:13:15.314664 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1719a3de3f1c4c26a352f6894a443275" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dcd17650d74dab94717ff1c4564d59" is_pre_election: true
I20260810 03:13:15.314699 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1719a3de3f1c4c26a352f6894a443275" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a9a2c992664c778eb5515a7184efe2" is_pre_election: true
I20260810 03:13:15.314863 29942 raft_consensus.cc:2454] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 0.
I20260810 03:13:15.314896 29483 raft_consensus.cc:2454] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 0.
I20260810 03:13:15.315320 29610 leader_election.cc:302] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb3949f331847e1bdde6cffaf7cc115, a8a9a2c992664c778eb5515a7184efe2; no voters:
I20260810 03:13:15.315574 30176 raft_consensus.cc:2781] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:15.315680 30176 raft_consensus.cc:482] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:15.315766 30176 raft_consensus.cc:3037] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:15.317708 30176 raft_consensus.cc:504] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.318145 30176 leader_election.cc:288] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 election: Requested vote from peers b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899), a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421)
I20260810 03:13:15.318535 29942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1719a3de3f1c4c26a352f6894a443275" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6dcd17650d74dab94717ff1c4564d59"
I20260810 03:13:15.318598 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1719a3de3f1c4c26a352f6894a443275" candidate_uuid: "3cb3949f331847e1bdde6cffaf7cc115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a9a2c992664c778eb5515a7184efe2"
I20260810 03:13:15.318704 29942 raft_consensus.cc:3037] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:15.318758 29483 raft_consensus.cc:3037] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:15.320767 29483 raft_consensus.cc:2454] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 1.
I20260810 03:13:15.320840 29942 raft_consensus.cc:2454] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb3949f331847e1bdde6cffaf7cc115 in term 1.
I20260810 03:13:15.321115 29610 leader_election.cc:302] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb3949f331847e1bdde6cffaf7cc115, a8a9a2c992664c778eb5515a7184efe2; no voters:
I20260810 03:13:15.321362 30176 raft_consensus.cc:2781] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:15.321743 30176 raft_consensus.cc:686] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb3949f331847e1bdde6cffaf7cc115, State: Running, Role: LEADER
I20260810 03:13:15.322170 30176 consensus_queue.cc:237] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } }
I20260810 03:13:15.322638 30180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.322201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:55511)
0810 03:13:15.322341 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.322500 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 03:13:15.324877 29269 catalog_manager.cc:5495] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66). New cstate: current_term: 1 leader_uuid: "3cb3949f331847e1bdde6cffaf7cc115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb3949f331847e1bdde6cffaf7cc115" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 } health_report { overall_health: UNKNOWN } } }
I20260810 03:13:15.354338 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.350321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57008 (local address 127.18.112.66:34541)
0810 03:13:15.350485 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.350490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.350506 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:13:15.350557 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.350560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.350619 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.350697 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:15.350988 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.351695 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.352918 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.353370 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.353474 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.353793 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:15.353890 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:15.353950 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.354033 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.354090 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:13:15.357156 29942 raft_consensus.cc:1261] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Refusing update from remote peer 3cb3949f331847e1bdde6cffaf7cc115: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:15.357360 29483 raft_consensus.cc:1261] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Refusing update from remote peer 3cb3949f331847e1bdde6cffaf7cc115: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:15.357795 30182 consensus_queue.cc:1035] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6dcd17650d74dab94717ff1c4564d59" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 35899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:15.358085 30176 consensus_queue.cc:1035] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8a9a2c992664c778eb5515a7184efe2" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:15.360411 30165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.359956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:38763)
0810 03:13:15.360121 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.360235 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 03:13:15.360601 30177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.360186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:44771)
0810 03:13:15.360333 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.360437 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 03:13:15.373639 30189 mvcc.cc:205] Tried to move back new op lower bound from 7316814214577418240 to 7316814214441484288. Current Snapshot: MvccSnapshot[applied={T|T < 7316814214577418240}]
I20260810 03:13:15.374508 30165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.374033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.67:51477)
0810 03:13:15.374253 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.374333 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260810 03:13:15.375792 30180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.375279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.66:53819)
0810 03:13:15.375532 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.375627 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260810 03:13:15.377589 30177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.377084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.18.112.65:41943)
0810 03:13:15.377316 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.377411 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260810 03:13:15.378100 30188 mvcc.cc:205] Tried to move back new op lower bound from 7316814214577418240 to 7316814214441484288. Current Snapshot: MvccSnapshot[applied={T|T < 7316814214577418240}]
I20260810 03:13:15.385340 29270 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:15.385546 29270 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:15.390566 29270 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 414a790f150e479689c880eadb55caef: Sending DeleteTablet for 3 replicas of tablet 1719a3de3f1c4c26a352f6894a443275
I20260810 03:13:15.391487 29918 tablet_service.cc:1514] Processing DeleteTablet for tablet 1719a3de3f1c4c26a352f6894a443275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:15 UTC) from {username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:38436
I20260810 03:13:15.391523 29692 tablet_service.cc:1514] Processing DeleteTablet for tablet 1719a3de3f1c4c26a352f6894a443275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:15 UTC) from {username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:56992
I20260810 03:13:15.392211 30198 tablet_replica.cc:330] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: stopping tablet replica
I20260810 03:13:15.392364 29455 tablet_service.cc:1514] Processing DeleteTablet for tablet 1719a3de3f1c4c26a352f6894a443275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:15 UTC) from {username='oryx', principal='oryx/127.18.112.124@KRBTEST.COM'} at 127.0.0.1:41046
I20260810 03:13:15.392459 30200 tablet_replica.cc:330] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: stopping tablet replica
I20260810 03:13:15.392457 30198 raft_consensus.cc:2229] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:15.392642 30200 raft_consensus.cc:2229] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:15.392736 30198 raft_consensus.cc:2258] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:15.393028 30200 raft_consensus.cc:2258] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:15.393785 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 29243
I20260810 03:13:15.394050 30200 ts_tablet_manager.cc:1905] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:15.395998 30198 ts_tablet_manager.cc:1905] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:15.402570 30198 ts_tablet_manager.cc:1918] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:15.402690 30198 log.cc:1196] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/1719a3de3f1c4c26a352f6894a443275
I20260810 03:13:15.403122 30198 ts_tablet_manager.cc:1939] T 1719a3de3f1c4c26a352f6894a443275 P b6dcd17650d74dab94717ff1c4564d59: Deleting consensus metadata
I20260810 03:13:15.404222 29246 catalog_manager.cc:4841] TS b6dcd17650d74dab94717ff1c4564d59 (127.18.112.67:35899): tablet 1719a3de3f1c4c26a352f6894a443275 (table test-table [id=a294377582bc4cf8bf1c49cc5555b839]) successfully deleted
I20260810 03:13:15.405658 30200 ts_tablet_manager.cc:1918] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:15.405776 30200 log.cc:1196] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/1719a3de3f1c4c26a352f6894a443275
I20260810 03:13:15.406117 30200 ts_tablet_manager.cc:1939] T 1719a3de3f1c4c26a352f6894a443275 P 3cb3949f331847e1bdde6cffaf7cc115: Deleting consensus metadata
I20260810 03:13:15.406966 29249 catalog_manager.cc:4841] TS 3cb3949f331847e1bdde6cffaf7cc115 (127.18.112.66:34541): tablet 1719a3de3f1c4c26a352f6894a443275 (table test-table [id=a294377582bc4cf8bf1c49cc5555b839]) successfully deleted
I20260810 03:13:15.407145 30201 tablet_replica.cc:330] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: stopping tablet replica
I20260810 03:13:15.407308 30201 raft_consensus.cc:2229] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:15.407577 30201 raft_consensus.cc:2258] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:15.408373 30201 ts_tablet_manager.cc:1905] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:15.413020 30201 ts_tablet_manager.cc:1918] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:15.413134 30201 log.cc:1196] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/1719a3de3f1c4c26a352f6894a443275
I20260810 03:13:15.413489 30201 ts_tablet_manager.cc:1939] T 1719a3de3f1c4c26a352f6894a443275 P a8a9a2c992664c778eb5515a7184efe2: Deleting consensus metadata
I20260810 03:13:15.414324 29246 catalog_manager.cc:4841] TS a8a9a2c992664c778eb5515a7184efe2 (127.18.112.65:38421): tablet 1719a3de3f1c4c26a352f6894a443275 (table test-table [id=a294377582bc4cf8bf1c49cc5555b839]) successfully deleted
I20260810 03:13:15.415539 30158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.394499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41048 (local address 127.18.112.65:38421)
0810 03:13:15.394739 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.394747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.400285 (+ 5538us) server_negotiation.cc:407] Connection header received
0810 03:13:15.400529 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.400534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.400616 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.400686 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:15.402630 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.403837 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.405897 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.406644 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.406738 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.409644 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:15.409658 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:15.409673 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:15.409708 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:15.412763 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.413434 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.413442 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.413444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.413640 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.413982 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.413987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.413991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.414437 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:15.414721 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.415000 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.415223 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:13:15.416105 29547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:15.508096 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 29243
I20260810 03:13:15.530694 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 29573
I20260810 03:13:15.543149 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.531374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.18.112.66:34541)
0810 03:13:15.531580 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.531585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.531649 (+ 64us) server_negotiation.cc:407] Connection header received
0810 03:13:15.531826 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.531832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.531900 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.531978 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:15.533237 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.534022 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.535262 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.535649 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.535740 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.538115 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:15.538137 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:15.538155 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:15.538194 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:15.540896 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.541469 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.541476 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.541478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.541613 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.541877 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.541880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.541882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.542230 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:15.542493 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.542669 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.542819 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:13:15.543778 29785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:15.661499 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 29573
I20260810 03:13:15.685164 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 29809
I20260810 03:13:15.697911 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.685870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.18.112.67:35899)
0810 03:13:15.686086 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:15.686091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:15.686110 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:15.686241 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:15.686245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:15.686308 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:15.686396 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:15.687725 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.688470 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.689652 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:15.690111 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:15.690233 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:15.692739 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:15.692755 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:15.692771 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:15.692804 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:15.695301 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.695930 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.695940 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.695944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.696077 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:15.696433 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:15.696438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:15.696441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:15.696814 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:15.697085 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:15.697399 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 03:13:15.697622 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:13:15.698498 29998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:15.789479 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 29809
I20260810 03:13:15.813174 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28776
I20260810 03:13:15.814035 30211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.813295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32884)
0810 03:13:15.813736 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.813852 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":206,"threads_started":1}
I20260810 03:13:15.814390 29033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:15.816906 30211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:15.816508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33079 (local address 127.0.0.1:32894)
0810 03:13:15.816668 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:15.816754 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:33079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 03:13:15.929708 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28776
I20260810 03:13:15.955077 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 28937
I20260810 03:13:15.956153 29318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:16.074189 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 28937
2026-08-10T03:13:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9722 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:16 dist-test-slave-jlzn krb5kdc[30218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:16 dist-test-slave-jlzn krb5kdc[30218](info): set up 2 sockets
Aug 10 03:13:16 dist-test-slave-jlzn krb5kdc[30218](info): commencing operation
krb5kdc: starting...
W20260810 03:13:17.267315 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:17 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab.
Entry for principal oryx/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab.
I20260810 03:13:17.478495 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44231
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab
--principal=oryx/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:17.792153 30245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:17.792416 30245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:17.792518 30245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:17.799467 30245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:17.799559 30245 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:13:17.799610 30245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:17.799669 30245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:17.799716 30245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:17.799774 30245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:17.809207 30245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44231
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.126.keytab
--principal=oryx/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:17.810338 30245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:17.811522 30245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:17.822734 30257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:17.822767 30260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:17.822853 30251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:17.823673 30245 server_base.cc:1034] running on GCE node
I20260810 03:13:17.824401 30245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:17.825678 30245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:17.826900 30245 hybrid_clock.cc:648] HybridClock initialized: now 1786331597826834 us; error 37 us; skew 500 ppm
I20260810 03:13:17.827201 30245 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:17 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331597, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:17.830114 30245 init.cc:377] Logged in from keytab as oryx/127.18.112.126@KRBTEST.COM (short username oryx)
I20260810 03:13:17.831452 30245 webserver.cc:460] Webserver started at http://127.18.112.126:33425/ using document root <none> and password file <none>
I20260810 03:13:17.832162 30245 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:17.832262 30245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:17.832563 30245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:17.835407 30245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "5a2c9a9517164277abf60da17a063dab"
format_stamp: "Formatted at 2026-08-10 03:13:17 on dist-test-slave-jlzn"
server_key: "c6739dd82fd7a921e4c65f72eada4f29"
server_key_iv: "f747f20cce7c14ce4a22c076d39b2a6f"
server_key_version: "encryptionkey@0"
I20260810 03:13:17.836195 30245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "5a2c9a9517164277abf60da17a063dab"
format_stamp: "Formatted at 2026-08-10 03:13:17 on dist-test-slave-jlzn"
server_key: "c6739dd82fd7a921e4c65f72eada4f29"
server_key_iv: "f747f20cce7c14ce4a22c076d39b2a6f"
server_key_version: "encryptionkey@0"
I20260810 03:13:17.840854 30245 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:13:17.844013 30269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:17.845209 30245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:13:17.845377 30245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "5a2c9a9517164277abf60da17a063dab"
format_stamp: "Formatted at 2026-08-10 03:13:17 on dist-test-slave-jlzn"
server_key: "c6739dd82fd7a921e4c65f72eada4f29"
server_key_iv: "f747f20cce7c14ce4a22c076d39b2a6f"
server_key_version: "encryptionkey@0"
I20260810 03:13:17.845575 30245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:17.874353 30245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:17.878044 30245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:17.878278 30245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:17.897673 30245 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44231
I20260810 03:13:17.897692 30356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44231 every 8 connection(s)
I20260810 03:13:17.898931 30245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:17.902709 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:17.906424 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 30245
I20260810 03:13:17.906674 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:17.907456 18881 external_mini_cluster.cc:1428] Setting key ec59b7f205fd830bceec7558c0f06503
I20260810 03:13:17.915565 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Bootstrap starting.
I20260810 03:13:17.919109 30357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:17.920400 30357 log.cc:824] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:13:17 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:17.923106 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: No bootstrap required, opened a new log
I20260810 03:13:17.929275 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:17.909477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.18.112.126:44231)
0810 03:13:17.910184 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:17.910195 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:17.910235 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:13:17.911770 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:17.911792 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:17.912177 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:17.912488 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:17.914214 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:17.915450 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:17.917117 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:17.917769 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:17.917889 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:17.922509 (+ 4620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:17.922516 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:17.922536 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:17.922570 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:17.925477 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:17.926115 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:17.926121 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:17.926127 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:17.926301 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:17.926650 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:17.926654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:17.926656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:17.927202 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:17.927503 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:17.927921 (+ 418us) server_negotiation.cc:299] Negotiation successful
0810 03:13:17.928337 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":329,"threads_started":1}
I20260810 03:13:17.931094 30357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } }
I20260810 03:13:17.931422 30357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:17.931527 30357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a2c9a9517164277abf60da17a063dab, State: Initialized, Role: FOLLOWER
I20260810 03:13:17.932130 30357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } }
I20260810 03:13:17.932375 30357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:17.932505 30357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:17.932687 30357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:17.934935 30357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } }
I20260810 03:13:17.935385 30357 leader_election.cc:302] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a2c9a9517164277abf60da17a063dab; no voters:
I20260810 03:13:17.935943 30357 leader_election.cc:288] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:17.936036 30364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:17.936668 30364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [term 1 LEADER]: Becoming Leader. State: Replica: 5a2c9a9517164277abf60da17a063dab, State: Running, Role: LEADER
I20260810 03:13:17.937153 30364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } }
I20260810 03:13:17.937861 30357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:17.939693 30365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a2c9a9517164277abf60da17a063dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } } }
I20260810 03:13:17.940047 30365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:17.940697 30366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a2c9a9517164277abf60da17a063dab. Latest consensus state: current_term: 1 leader_uuid: "5a2c9a9517164277abf60da17a063dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a2c9a9517164277abf60da17a063dab" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44231 } } }
I20260810 03:13:17.940992 30366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:17.941498 30371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:17.945983 30371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:17.954260 30371 catalog_manager.cc:1347] Generated new cluster ID: 366458b6945b4ed8b49fee664ec94430
I20260810 03:13:17.954355 30371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:17.971288 30371 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:17.972540 30371 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:17.982837 30371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Generated new TSK 0
I20260810 03:13:17.983556 30371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
I20260810 03:13:18.042402 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44231
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:18.355226 30391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:18.355472 30391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:18.355602 30391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:18.362473 30391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:18.362568 30391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:18.362696 30391 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:13:18.362803 30391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:18.371863 30391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:18.372913 30391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:18.374114 30391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:18.385916 30402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:18.386018 30404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:18.385885 30408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:18.386902 30391 server_base.cc:1034] running on GCE node
I20260810 03:13:18.387451 30391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:18.388409 30391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:18.389657 30391 hybrid_clock.cc:648] HybridClock initialized: now 1786331598389575 us; error 51 us; skew 500 ppm
I20260810 03:13:18.389940 30391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:18 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331598, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:18.392907 30391 init.cc:377] Logged in from keytab as oryx/127.18.112.65@KRBTEST.COM (short username oryx)
I20260810 03:13:18.394244 30391 webserver.cc:460] Webserver started at http://127.18.112.65:44527/ using document root <none> and password file <none>
I20260810 03:13:18.394884 30391 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:18.394969 30391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:18.395244 30391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:18.398077 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "1db9255914a245a59bc20075d8d8dd55"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "0430ac2f4ab8ef2651f3df934db95a8d"
server_key_iv: "b0865d05176d7b286b7b4fcfb08b2fb7"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.398970 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "1db9255914a245a59bc20075d8d8dd55"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "0430ac2f4ab8ef2651f3df934db95a8d"
server_key_iv: "b0865d05176d7b286b7b4fcfb08b2fb7"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.403957 30391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 03:13:18.407143 30417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:18.408397 30391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:18.408565 30391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "1db9255914a245a59bc20075d8d8dd55"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "0430ac2f4ab8ef2651f3df934db95a8d"
server_key_iv: "b0865d05176d7b286b7b4fcfb08b2fb7"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.408757 30391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:18.447508 30391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:18.451397 30391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:18.451663 30391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:18.454229 30391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:18.454337 30391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:18.454478 30391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:18.454559 30391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:13:18 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331598, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:18.484344 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.454799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:59483 (local address 127.18.112.126:44231)
0810 03:13:18.456116 (+ 1317us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:18.456121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:18.462719 (+ 6598us) server_negotiation.cc:407] Connection header received
0810 03:13:18.465971 (+ 3252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:18.465978 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:18.466067 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:18.466194 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:18.467976 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.469116 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.472118 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.472653 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.472782 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.477659 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:18.477665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:18.477670 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:18.477713 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:18.480657 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.481576 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.481582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.481586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.481759 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.482285 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.482288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.482290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.482578 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:18.482760 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:18.483682 (+ 922us) server_negotiation.cc:299] Negotiation successful
0810 03:13:18.483953 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1218,"thread_start_us":1126,"threads_started":1}
I20260810 03:13:18.485146 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.455517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.65:59483)
0810 03:13:18.462532 (+ 7015us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:18.462588 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:18.465558 (+ 2970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:18.466427 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:18.466436 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:18.466954 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:18.467747 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.467783 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.469326 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.469331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.471939 (+ 2608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.471962 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.473076 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.473085 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.473363 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.474048 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:18.474078 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:18.477390 (+ 3312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:18.480798 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.480807 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.480823 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.481412 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.481898 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.481903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.481906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.482165 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.482847 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:18.482855 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:18.483219 (+ 364us) client_negotiation.cc:769] Sending connection context
0810 03:13:18.483527 (+ 308us) client_negotiation.cc:240] Negotiation successful
0810 03:13:18.484011 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6682,"thread_start_us":10405,"threads_started":1}
I20260810 03:13:18.498075 30391 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:36721
I20260810 03:13:18.498138 30596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:36721 every 8 connection(s)
I20260810 03:13:18.499416 30391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:18.501479 30597 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44231
I20260810 03:13:18.501688 30597 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:18.502425 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 30391
I20260810 03:13:18.502434 30597 heartbeater.cc:511] Master 127.18.112.126:44231 requested a full tablet report, sending...
I20260810 03:13:18.502657 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:18.503443 18881 external_mini_cluster.cc:1428] Setting key 2e1a86056092c50c7bd9f5b9679370a7
I20260810 03:13:18.504683 30568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.490605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.65:35767)
0810 03:13:18.491378 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:18.491398 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:18.491565 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:18.492091 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:18.492096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:18.492725 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:18.493159 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.493174 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.494527 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.494530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.495793 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.495844 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.496742 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.496749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.496946 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.497610 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:18.497634 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:18.498619 (+ 985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:18.502145 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.502150 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.502155 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.502539 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.502933 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.502938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.502942 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.503068 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.503651 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:18.503656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:18.503850 (+ 194us) client_negotiation.cc:769] Sending connection context
0810 03:13:18.503987 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 03:13:18.504269 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":408,"threads_started":1}
I20260810 03:13:18.504706 30294 ts_manager.cc:194] Registered new tserver with Master: 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721)
I20260810 03:13:18.504947 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.490599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:35767 (local address 127.18.112.126:44231)
0810 03:13:18.490784 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:18.490790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:18.491504 (+ 714us) server_negotiation.cc:407] Connection header received
0810 03:13:18.491688 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:18.491693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:18.491770 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:18.491904 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:18.493332 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.494395 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.495981 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.496541 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.496676 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.498791 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:18.498798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:18.498802 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:18.498839 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:18.502019 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.502669 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.502673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.502675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.502828 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.503175 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.503180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.503184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.503498 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:18.503675 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:18.504384 (+ 709us) server_negotiation.cc:299] Negotiation successful
0810 03:13:18.504592 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:13:18.506649 30294 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:59483
WARNING: no policy specified for oryx/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
I20260810 03:13:18.552778 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44231
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:18.865340 30602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:18.865723 30602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:18.865880 30602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:18.876509 30602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:18.876621 30602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:18.876749 30602 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:13:18.876849 30602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:18.887161 30602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:18.888527 30602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:18.889829 30602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:18.902398 30608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:18.902932 30609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:18.903404 30612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:18.903693 30602 server_base.cc:1034] running on GCE node
I20260810 03:13:18.904352 30602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:18.905256 30602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:18.906505 30602 hybrid_clock.cc:648] HybridClock initialized: now 1786331598906424 us; error 45 us; skew 500 ppm
I20260810 03:13:18.906800 30602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:18 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331598, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:18.910071 30602 init.cc:377] Logged in from keytab as oryx/127.18.112.66@KRBTEST.COM (short username oryx)
I20260810 03:13:18.911509 30602 webserver.cc:460] Webserver started at http://127.18.112.66:39959/ using document root <none> and password file <none>
I20260810 03:13:18.912252 30602 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:18.912344 30602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:18.912655 30602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:18.915493 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "9117897b08784f6a85a556ea1f98fe1e"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "f713ff2668a8cdc79cce1fb787eb2b0b"
server_key_iv: "d488c3c4017e73802ab39fd1b55ae5d1"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.916272 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "9117897b08784f6a85a556ea1f98fe1e"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "f713ff2668a8cdc79cce1fb787eb2b0b"
server_key_iv: "d488c3c4017e73802ab39fd1b55ae5d1"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.921180 30602 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 03:13:18.924382 30625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:18.925591 30602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260810 03:13:18.925726 30602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "9117897b08784f6a85a556ea1f98fe1e"
format_stamp: "Formatted at 2026-08-10 03:13:18 on dist-test-slave-jlzn"
server_key: "f713ff2668a8cdc79cce1fb787eb2b0b"
server_key_iv: "d488c3c4017e73802ab39fd1b55ae5d1"
server_key_version: "encryptionkey@0"
I20260810 03:13:18.925921 30602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:18.937175 30602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:18.940896 30602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:18.941143 30602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:18.943698 30602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:18.943797 30602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:18.943948 30602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:18.944352 30602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:13:18 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331598, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:18.964066 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.944249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57245 (local address 127.18.112.126:44231)
0810 03:13:18.944414 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:18.944419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:18.945667 (+ 1248us) server_negotiation.cc:407] Connection header received
0810 03:13:18.947678 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:18.947684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:18.947762 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:18.947882 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:18.950028 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.951035 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.953076 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.953649 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.953763 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.958094 (+ 4331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:18.958099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:18.958103 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:18.958141 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:18.960711 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.961623 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.961629 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.961633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.961805 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.962346 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.962352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.962356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.962646 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:18.962781 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:18.963472 (+ 691us) server_negotiation.cc:299] Negotiation successful
0810 03:13:18.963712 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:13:18.965000 30636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.944787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.66:57245)
0810 03:13:18.945524 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:18.945562 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:18.947400 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:18.948107 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:18.948115 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:18.948888 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:18.949849 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.949879 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.951199 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.951205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.952913 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.952936 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.954120 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.954126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.954365 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.955083 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:18.955113 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:18.957896 (+ 2783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:18.960849 (+ 2953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.960858 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.960875 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.961482 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.961936 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.961941 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.961945 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.962221 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.962781 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:18.962789 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:18.963104 (+ 315us) client_negotiation.cc:769] Sending connection context
0810 03:13:18.963338 (+ 234us) client_negotiation.cc:240] Negotiation successful
0810 03:13:18.963799 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":320,"threads_started":1}
I20260810 03:13:18.994948 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.982319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:55127 (local address 127.18.112.126:44231)
0810 03:13:18.982462 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:18.982466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:18.983085 (+ 619us) server_negotiation.cc:407] Connection header received
0810 03:13:18.983282 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:18.983288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:18.983388 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:18.983488 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:18.984567 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.985568 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.987276 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.987701 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.987828 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.989498 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:18.989503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:18.989506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:18.989535 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:18.991970 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.992849 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.992855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.992859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.993025 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:18.993451 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:18.993456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:18.993460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:18.993889 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:18.994030 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:18.994412 (+ 382us) server_negotiation.cc:299] Negotiation successful
0810 03:13:18.994626 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:13:18.995143 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:18.982359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.66:55127)
0810 03:13:18.982963 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:18.982982 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:18.983124 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:18.983508 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:18.983512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:18.983960 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:18.984351 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.984376 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.985704 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.985708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.987121 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:18.987143 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:18.987893 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:18.987900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:18.988037 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:18.988605 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:18.988640 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:18.989324 (+ 684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:18.992100 (+ 2776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.992105 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.992109 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.992662 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.993151 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:18.993160 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:18.993163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:18.993339 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:18.994006 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:18.994011 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:18.994185 (+ 174us) client_negotiation.cc:769] Sending connection context
0810 03:13:18.994303 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 03:13:18.994661 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":327,"threads_started":1}
I20260810 03:13:18.996490 30602 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:33467
I20260810 03:13:18.996531 30786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:33467 every 8 connection(s)
I20260810 03:13:18.997846 30602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:18.999850 30788 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44231
I20260810 03:13:19.000072 30788 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:19.000666 30788 heartbeater.cc:511] Master 127.18.112.126:44231 requested a full tablet report, sending...
I20260810 03:13:19.001875 30294 ts_manager.cc:194] Registered new tserver with Master: 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467)
I20260810 03:13:19.002663 30294 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:57245
I20260810 03:13:19.005723 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 30602
I20260810 03:13:19.005892 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:19.006306 18881 external_mini_cluster.cc:1428] Setting key dd39d50c4282e7edb6e4359dadc10121
WARNING: no policy specified for oryx/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
I20260810 03:13:19.053990 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44231
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:19.370148 30794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:19.370451 30794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:19.370599 30794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:19.377430 30794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:19.377525 30794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:19.377660 30794 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:13:19.377759 30794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:19.387063 30794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.112.126:44231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:19.388190 30794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:19.389391 30794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:19.401317 30805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:19.401399 30806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:19.401364 30809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:19.402235 30794 server_base.cc:1034] running on GCE node
I20260810 03:13:19.402755 30794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:19.403540 30794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:19.404749 30794 hybrid_clock.cc:648] HybridClock initialized: now 1786331599404728 us; error 87 us; skew 500 ppm
I20260810 03:13:19.404984 30794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331599, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:19.407871 30794 init.cc:377] Logged in from keytab as oryx/127.18.112.67@KRBTEST.COM (short username oryx)
I20260810 03:13:19.409154 30794 webserver.cc:460] Webserver started at http://127.18.112.67:46351/ using document root <none> and password file <none>
I20260810 03:13:19.409744 30794 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:19.409828 30794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:19.410075 30794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:19.412820 30794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
format_stamp: "Formatted at 2026-08-10 03:13:19 on dist-test-slave-jlzn"
server_key: "a42cab32a791beab9b721f1c47d224aa"
server_key_iv: "7d098434736e1a6a06b9ea0070e0ae88"
server_key_version: "encryptionkey@0"
I20260810 03:13:19.413537 30794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
format_stamp: "Formatted at 2026-08-10 03:13:19 on dist-test-slave-jlzn"
server_key: "a42cab32a791beab9b721f1c47d224aa"
server_key_iv: "7d098434736e1a6a06b9ea0070e0ae88"
server_key_version: "encryptionkey@0"
I20260810 03:13:19.418233 30794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:19.421357 30820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:19.422505 30794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:13:19.422667 30794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
format_stamp: "Formatted at 2026-08-10 03:13:19 on dist-test-slave-jlzn"
server_key: "a42cab32a791beab9b721f1c47d224aa"
server_key_iv: "7d098434736e1a6a06b9ea0070e0ae88"
server_key_version: "encryptionkey@0"
I20260810 03:13:19.422854 30794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:19.466703 30794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:19.470515 30794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:19.470777 30794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:19.473479 30794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:19.473588 30794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:19.473747 30794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:19.473861 30794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331599, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:19.494539 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.473901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:54729 (local address 127.18.112.126:44231)
0810 03:13:19.474058 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.474062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.475536 (+ 1474us) server_negotiation.cc:407] Connection header received
0810 03:13:19.477494 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.477500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.477584 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.477680 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:19.479711 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.480706 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.483076 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.483618 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.483737 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.488124 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:19.488131 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:19.488135 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:19.488175 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:19.491311 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.492240 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.492245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.492249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.492417 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.492866 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.492871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.492875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.493129 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:19.493275 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.493959 (+ 684us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.494195 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:13:19.495347 30834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.474574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.67:54729)
0810 03:13:19.475373 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.475410 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.477219 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.477918 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.477926 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.478618 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:19.479449 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.479479 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.480883 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.480889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.482933 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.482948 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.483888 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.483898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.484102 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.484879 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:19.484905 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:19.487900 (+ 2995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:19.491452 (+ 3552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:19.491461 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:19.491481 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:19.492063 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:19.492548 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:19.492552 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:19.492557 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:19.492747 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:19.493260 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:19.493268 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:19.493571 (+ 303us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.493788 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.494243 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":371,"threads_started":1}
I20260810 03:13:19.509384 30597 heartbeater.cc:503] Master 127.18.112.126:44231 was elected leader, sending a full tablet report...
I20260810 03:13:19.521077 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.507369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:58259 (local address 127.18.112.126:44231)
0810 03:13:19.507544 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.507550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.508247 (+ 697us) server_negotiation.cc:407] Connection header received
0810 03:13:19.508351 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.508357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.508449 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.508555 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:19.509387 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.510260 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.512704 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.513271 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.513364 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.515447 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:19.515452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:19.515455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:19.515482 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:19.518354 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.519228 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.519233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.519236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.519392 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.519784 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.519786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.519789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.520076 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:19.520189 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.520690 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.520846 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:13:19.521459 30942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.507449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.18.112.67:58259)
0810 03:13:19.508150 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.508165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.508264 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.508562 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.508564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.508965 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:19.509247 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.509256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.510424 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.510430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.512549 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.512569 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.513452 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.513460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.513666 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.514230 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:19.514252 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:19.515271 (+ 1019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:19.518463 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:19.518469 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:19.518476 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:19.519064 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:19.519513 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:19.519517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:19.519521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:19.519682 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:19.520190 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:19.520195 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:19.520418 (+ 223us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.520599 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.520940 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":369,"threads_started":1}
I20260810 03:13:19.529392 30794 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:45829
I20260810 03:13:19.529438 31004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:45829 every 8 connection(s)
I20260810 03:13:19.530506 30794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:19.532325 31005 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44231
I20260810 03:13:19.532557 31005 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:19.532682 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 30794
I20260810 03:13:19.532878 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:19.533295 31005 heartbeater.cc:511] Master 127.18.112.126:44231 requested a full tablet report, sending...
I20260810 03:13:19.533432 18881 external_mini_cluster.cc:1428] Setting key 8e0681188dbb9481b15835366df80e80
I20260810 03:13:19.534600 30294 ts_manager.cc:194] Registered new tserver with Master: afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:19.535507 30294 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:54729
I20260810 03:13:19.536319 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331599, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:13:19.591610 30437 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:19.577944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.18.112.126:44231)
0810 03:13:19.578141 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.578146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.578511 (+ 365us) server_negotiation.cc:407] Connection header received
0810 03:13:19.578657 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.578661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.578731 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.578813 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:19.580124 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.580853 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.582005 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.582414 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.582509 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.591292 (+ 8783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56768: BlockingRecv error: recv got EOF from 127.0.0.1:56768 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 10 03:13:19 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331599, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:19.606212 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.594600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56784 (local address 127.18.112.126:44231)
0810 03:13:19.594764 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.594767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.595016 (+ 249us) server_negotiation.cc:407] Connection header received
0810 03:13:19.595155 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.595158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.595230 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.595300 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:19.596379 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.597130 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.598288 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.598766 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.598879 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.602081 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:19.602085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:19.602089 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:19.602117 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:19.604326 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.604875 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.604878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.604880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.604991 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:19.605265 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:19.605268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:19.605270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:19.605495 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:19.605725 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.605854 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.606001 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:13:19.609735 30292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:19.616544 30292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:19.647419 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.627770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33310 (local address 127.18.112.66:33467)
0810 03:13:19.639099 (+ 11329us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.639107 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.639377 (+ 270us) server_negotiation.cc:407] Connection header received
0810 03:13:19.639469 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.639475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.639672 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.639865 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:19.641150 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.642345 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.645182 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.646323 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.646429 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.646564 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.646967 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.647140 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11176,"thread_start_us":11154,"threads_started":1}
I20260810 03:13:19.647454 31036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.627542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33467 (local address 127.0.0.1:33310)
0810 03:13:19.639133 (+ 11591us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.639151 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.639270 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.640076 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.640084 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.640107 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:19.640903 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.640917 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.642453 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.642458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.645019 (+ 2561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.645028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.646513 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.646519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.646695 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.646745 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.646874 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.647044 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9906,"mutex_wait_us":30,"thread_start_us":10502,"threads_started":1}
I20260810 03:13:19.648380 31044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.630112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38530 (local address 127.18.112.67:45829)
0810 03:13:19.640769 (+ 10657us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.640777 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.641218 (+ 441us) server_negotiation.cc:407] Connection header received
0810 03:13:19.641409 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.641417 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.641646 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.641820 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:19.642407 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.643952 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.645917 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.647041 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.647159 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.647384 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.647905 (+ 521us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.648060 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10471,"thread_start_us":10282,"threads_started":1}
I20260810 03:13:19.648918 31043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.629780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:45829 (local address 127.0.0.1:38530)
0810 03:13:19.641094 (+ 11314us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.641113 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.641240 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.641830 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.641835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.641859 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:19.642193 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.642202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.644075 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.644080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.645768 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.645785 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.647531 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.647537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.647697 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.647729 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.648400 (+ 671us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.648527 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11203,"mutex_wait_us":2,"thread_start_us":11036,"threads_started":1}
I20260810 03:13:19.648959 31031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.627735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:36721 (local address 127.0.0.1:38504)
0810 03:13:19.638373 (+ 10638us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.638410 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.638595 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.639829 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.639838 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.639868 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:19.640267 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.640287 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.642631 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.642636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.645013 (+ 2377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.645028 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.648176 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.648183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.648338 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.648369 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.648449 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.648568 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10493,"mutex_wait_us":8,"thread_start_us":9585,"threads_started":1}
I20260810 03:13:19.651367 30694 tablet_service.cc:1467] Processing CreateTablet for tablet 87abc7f33da04cc39a38201566917d5a (DEFAULT_TABLE table=test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.651948 30893 tablet_service.cc:1467] Processing CreateTablet for tablet 87abc7f33da04cc39a38201566917d5a (DEFAULT_TABLE table=test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.652457 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.628350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.18.112.65:36721)
0810 03:13:19.628957 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.628966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.639182 (+ 10216us) server_negotiation.cc:407] Connection header received
0810 03:13:19.639294 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.639302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.639559 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.640905 (+ 1346us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:19.641109 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.642485 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.646636 (+ 4151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.647979 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.648114 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.648315 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.652026 (+ 3711us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.652188 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":278,"threads_started":1}
I20260810 03:13:19.652740 30694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87abc7f33da04cc39a38201566917d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.653218 30893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87abc7f33da04cc39a38201566917d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.655848 30493 tablet_service.cc:1467] Processing CreateTablet for tablet 87abc7f33da04cc39a38201566917d5a (DEFAULT_TABLE table=test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.657109 30493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87abc7f33da04cc39a38201566917d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.663511 31045 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Bootstrap starting.
I20260810 03:13:19.666460 31046 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Bootstrap starting.
I20260810 03:13:19.667987 31045 tablet_bootstrap.cc:654] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:19.669227 31045 log.cc:824] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:19.669675 31046 tablet_bootstrap.cc:654] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:19.669797 31047 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Bootstrap starting.
I20260810 03:13:19.670877 31046 log.cc:824] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:19.672863 31045 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: No bootstrap required, opened a new log
I20260810 03:13:19.672930 31047 tablet_bootstrap.cc:654] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:19.673142 31045 ts_tablet_manager.cc:1397] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260810 03:13:19.673882 31047 log.cc:824] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:19.674283 31046 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: No bootstrap required, opened a new log
I20260810 03:13:19.674608 31046 ts_tablet_manager.cc:1397] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.008s
I20260810 03:13:19.676491 31047 tablet_bootstrap.cc:492] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: No bootstrap required, opened a new log
I20260810 03:13:19.676715 31047 ts_tablet_manager.cc:1397] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:13:19.682991 31047 raft_consensus.cc:348] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.683308 31047 raft_consensus.cc:374] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:19.683144 31045 raft_consensus.cc:348] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.683410 31047 raft_consensus.cc:729] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Initialized, Role: FOLLOWER
I20260810 03:13:19.683526 31045 raft_consensus.cc:374] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:19.683631 31045 raft_consensus.cc:729] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Initialized, Role: FOLLOWER
I20260810 03:13:19.684038 31047 consensus_queue.cc:260] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.684211 31045 consensus_queue.cc:260] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.684440 31046 raft_consensus.cc:348] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.685026 31046 raft_consensus.cc:374] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:19.685200 31046 raft_consensus.cc:729] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9117897b08784f6a85a556ea1f98fe1e, State: Initialized, Role: FOLLOWER
I20260810 03:13:19.685590 31047 ts_tablet_manager.cc:1428] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s
I20260810 03:13:19.685907 31046 consensus_queue.cc:260] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.687458 31046 ts_tablet_manager.cc:1428] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260810 03:13:19.688032 30788 heartbeater.cc:503] Master 127.18.112.126:44231 was elected leader, sending a full tablet report...
I20260810 03:13:19.691213 31005 heartbeater.cc:503] Master 127.18.112.126:44231 was elected leader, sending a full tablet report...
I20260810 03:13:19.691998 31045 ts_tablet_manager.cc:1428] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent starting tablet: real 0.019s user 0.014s sys 0.006s
W20260810 03:13:19.749854 30789 tablet.cc:2369] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:13:19.752017 30598 tablet.cc:2369] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:13:19.781929 31007 tablet.cc:2369] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:13:19.846412 31055 raft_consensus.cc:482] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:19.846701 31055 raft_consensus.cc:504] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.848404 31055 leader_election.cc:288] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:19.857152 31044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.848933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:58211 (local address 127.18.112.67:45829)
0810 03:13:19.849102 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.849107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.849840 (+ 733us) server_negotiation.cc:407] Connection header received
0810 03:13:19.850047 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.850051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.850121 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.850201 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:19.851036 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.852165 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.854914 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.856130 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.856292 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.856367 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.856757 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.856883 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:13:19.857152 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.848897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:43995 (local address 127.18.112.66:33467)
0810 03:13:19.849092 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.849099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.849794 (+ 695us) server_negotiation.cc:407] Connection header received
0810 03:13:19.850007 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.850012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.850110 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.850219 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:19.851047 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.852173 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.854914 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.856131 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.856299 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.856367 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.856757 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.856883 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:13:19.857350 31062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.848656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:45829 (local address 127.18.112.65:58211)
0810 03:13:19.849737 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.849751 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.849894 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.850241 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.850247 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.850277 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:19.850874 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.850884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.852282 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.852287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.854747 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.854761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.856371 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.856377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.856585 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.856633 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.856729 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.856886 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"mutex_wait_us":270,"spinlock_wait_cycles":20736,"thread_start_us":525,"threads_started":1}
I20260810 03:13:19.857383 31064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.848646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33467 (local address 127.18.112.65:43995)
0810 03:13:19.849673 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:19.849694 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:19.849854 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:19.850241 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:19.850247 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:19.850302 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:19.850870 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.850884 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.852292 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.852296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.854746 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:19.854761 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.856347 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.856357 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:19.856592 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.856655 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 03:13:19.856729 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 03:13:19.856888 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"mutex_wait_us":179,"spinlock_wait_cycles":30464,"thread_start_us":684,"threads_started":1}
I20260810 03:13:19.858594 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87abc7f33da04cc39a38201566917d5a" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e" is_pre_election: true
I20260810 03:13:19.858597 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87abc7f33da04cc39a38201566917d5a" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" is_pre_election: true
I20260810 03:13:19.859159 30726 raft_consensus.cc:2454] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:19.859149 30936 raft_consensus.cc:2454] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:19.859849 30418 leader_election.cc:302] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:19.860234 31055 raft_consensus.cc:2781] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:19.860385 31055 raft_consensus.cc:482] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:19.860495 31055 raft_consensus.cc:3037] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:19.862636 31055 raft_consensus.cc:504] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.863231 31055 leader_election.cc:288] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Requested vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:19.863590 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87abc7f33da04cc39a38201566917d5a" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e"
I20260810 03:13:19.863682 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87abc7f33da04cc39a38201566917d5a" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
I20260810 03:13:19.863790 30726 raft_consensus.cc:3037] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:19.863883 30936 raft_consensus.cc:3037] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:19.866936 30936 raft_consensus.cc:2454] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:19.866932 30726 raft_consensus.cc:2454] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:19.867295 30418 leader_election.cc:302] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:19.867561 31055 raft_consensus.cc:2781] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:19.868031 31055 raft_consensus.cc:686] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Becoming Leader. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Running, Role: LEADER
I20260810 03:13:19.868527 31055 consensus_queue.cc:237] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:19.872542 30293 catalog_manager.cc:5495] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "1db9255914a245a59bc20075d8d8dd55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } health_report { overall_health: UNKNOWN } } }
I20260810 03:13:19.928009 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:19.923158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38516 (local address 127.18.112.65:36721)
0810 03:13:19.923373 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:19.923377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:19.923395 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:13:19.923594 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:19.923598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:19.923695 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:19.923838 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:19.924130 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.924830 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.926062 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:19.926488 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:19.926577 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:19.926943 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:19.927426 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:19.927547 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:19.927621 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 03:13:19.927693 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:13:19.935635 30726 raft_consensus.cc:1261] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:19.935633 30936 raft_consensus.cc:1261] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:19.936687 31055 consensus_queue.cc:1035] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:19.936964 31065 consensus_queue.cc:1035] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:19.947350 31068 mvcc.cc:205] Tried to move back new op lower bound from 7316814233327181824 to 7316814233064706048. Current Snapshot: MvccSnapshot[applied={T|T < 7316814233327181824}]
I20260810 03:13:19.950637 31069 mvcc.cc:205] Tried to move back new op lower bound from 7316814233327181824 to 7316814233064706048. Current Snapshot: MvccSnapshot[applied={T|T < 7316814233327181824}]
I20260810 03:13:19.959782 30292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:19.960047 30292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:19.963383 30292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Sending DeleteTablet for 3 replicas of tablet 87abc7f33da04cc39a38201566917d5a
I20260810 03:13:19.964423 30893 tablet_service.cc:1514] Processing DeleteTablet for tablet 87abc7f33da04cc39a38201566917d5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:19 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38530
I20260810 03:13:19.964416 30493 tablet_service.cc:1514] Processing DeleteTablet for tablet 87abc7f33da04cc39a38201566917d5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:19 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38504
I20260810 03:13:19.964426 30694 tablet_service.cc:1514] Processing DeleteTablet for tablet 87abc7f33da04cc39a38201566917d5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:19 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33310
I20260810 03:13:19.967031 30293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:19.967734 30293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:19.976379 30492 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 (DEFAULT_TABLE table=test-table [id=1ca3542f3d6744018b753d97e292e392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.976547 30892 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 (DEFAULT_TABLE table=test-table [id=1ca3542f3d6744018b753d97e292e392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.976994 30492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee8e2e4ea754893a8a5f70694708858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.977108 30892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee8e2e4ea754893a8a5f70694708858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.984229 30693 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 (DEFAULT_TABLE table=test-table [id=1ca3542f3d6744018b753d97e292e392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:19.984835 30693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee8e2e4ea754893a8a5f70694708858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:19.988073 31047 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Bootstrap starting.
I20260810 03:13:19.989825 31047 tablet_bootstrap.cc:654] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:19.991261 31083 tablet_replica.cc:330] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: stopping tablet replica
I20260810 03:13:19.991757 31083 raft_consensus.cc:2229] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:19.992491 31083 raft_consensus.cc:2258] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:19.992995 31081 tablet_replica.cc:330] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: stopping tablet replica
I20260810 03:13:19.994745 31081 raft_consensus.cc:2229] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:19.996202 31083 ts_tablet_manager.cc:1905] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:19.996675 31081 raft_consensus.cc:2258] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:19.999622 31082 tablet_replica.cc:330] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: stopping tablet replica
I20260810 03:13:20.000181 31045 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Bootstrap starting.
I20260810 03:13:20.000540 31046 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Bootstrap starting.
I20260810 03:13:20.001701 31045 tablet_bootstrap.cc:654] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.002148 31046 tablet_bootstrap.cc:654] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.003445 31047 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: No bootstrap required, opened a new log
I20260810 03:13:20.003646 31047 ts_tablet_manager.cc:1397] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20260810 03:13:20.004458 31047 raft_consensus.cc:348] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.004693 31047 raft_consensus.cc:374] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.004788 31047 raft_consensus.cc:729] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.005062 31047 consensus_queue.cc:260] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.005667 31047 ts_tablet_manager.cc:1428] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 03:13:20.006978 31083 ts_tablet_manager.cc:1918] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.007150 31083 log.cc:1196] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/87abc7f33da04cc39a38201566917d5a
I20260810 03:13:20.007690 31083 ts_tablet_manager.cc:1939] T 87abc7f33da04cc39a38201566917d5a P 9117897b08784f6a85a556ea1f98fe1e: Deleting consensus metadata
I20260810 03:13:20.003436 31082 raft_consensus.cc:2229] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:20.008527 31081 ts_tablet_manager.cc:1905] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.008507 31082 raft_consensus.cc:2258] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.009418 30274 catalog_manager.cc:4841] TS 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467): tablet 87abc7f33da04cc39a38201566917d5a (table test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]) successfully deleted
I20260810 03:13:20.011224 31082 ts_tablet_manager.cc:1905] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.018862 31046 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: No bootstrap required, opened a new log
I20260810 03:13:20.019097 31046 ts_tablet_manager.cc:1397] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.009s
I20260810 03:13:20.021040 31046 raft_consensus.cc:348] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.021325 31046 raft_consensus.cc:374] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.021474 31046 raft_consensus.cc:729] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9117897b08784f6a85a556ea1f98fe1e, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.022183 31046 consensus_queue.cc:260] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.024989 31046 ts_tablet_manager.cc:1428] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260810 03:13:20.027078 31082 ts_tablet_manager.cc:1918] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.027256 31082 log.cc:1196] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/87abc7f33da04cc39a38201566917d5a
I20260810 03:13:20.027782 31082 ts_tablet_manager.cc:1939] T 87abc7f33da04cc39a38201566917d5a P 1db9255914a245a59bc20075d8d8dd55: Deleting consensus metadata
I20260810 03:13:20.029369 30271 catalog_manager.cc:4841] TS 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721): tablet 87abc7f33da04cc39a38201566917d5a (table test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]) successfully deleted
I20260810 03:13:20.030284 31081 ts_tablet_manager.cc:1918] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.030536 31081 log.cc:1196] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/87abc7f33da04cc39a38201566917d5a
I20260810 03:13:20.031111 31045 tablet_bootstrap.cc:492] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: No bootstrap required, opened a new log
I20260810 03:13:20.031159 31081 ts_tablet_manager.cc:1939] T 87abc7f33da04cc39a38201566917d5a P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting consensus metadata
I20260810 03:13:20.031273 31045 ts_tablet_manager.cc:1397] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.013s
I20260810 03:13:20.032162 31045 raft_consensus.cc:348] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.032402 31045 raft_consensus.cc:374] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.032507 31045 raft_consensus.cc:729] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.032572 30270 catalog_manager.cc:4841] TS afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829): tablet 87abc7f33da04cc39a38201566917d5a (table test-table [id=fe9786f65c1d4c59ac34cf622ca728e7]) successfully deleted
I20260810 03:13:20.032757 31045 consensus_queue.cc:260] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.033301 31045 ts_tablet_manager.cc:1428] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 03:13:20.134924 31055 raft_consensus.cc:482] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:20.135138 31055 raft_consensus.cc:504] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.135771 31055 leader_election.cc:288] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:20.136356 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee8e2e4ea754893a8a5f70694708858" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e" is_pre_election: true
I20260810 03:13:20.136391 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee8e2e4ea754893a8a5f70694708858" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" is_pre_election: true
I20260810 03:13:20.136620 30726 raft_consensus.cc:2454] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:20.136672 30936 raft_consensus.cc:2454] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:20.137076 30426 leader_election.cc:302] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, 9117897b08784f6a85a556ea1f98fe1e; no voters:
I20260810 03:13:20.137379 31055 raft_consensus.cc:2781] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:20.137497 31055 raft_consensus.cc:482] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:20.137598 31055 raft_consensus.cc:3037] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.140044 31055 raft_consensus.cc:504] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.140610 31055 leader_election.cc:288] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Requested vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:20.141075 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee8e2e4ea754893a8a5f70694708858" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e"
I20260810 03:13:20.141129 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee8e2e4ea754893a8a5f70694708858" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
I20260810 03:13:20.141234 30726 raft_consensus.cc:3037] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.141328 30936 raft_consensus.cc:3037] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.143476 30726 raft_consensus.cc:2454] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:20.143919 30426 leader_election.cc:302] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, 9117897b08784f6a85a556ea1f98fe1e; no voters:
I20260810 03:13:20.144170 31055 raft_consensus.cc:2781] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:20.144335 31055 raft_consensus.cc:686] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Becoming Leader. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Running, Role: LEADER
I20260810 03:13:20.144620 31055 consensus_queue.cc:237] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.144711 30936 raft_consensus.cc:2454] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:20.147239 30293 catalog_manager.cc:5495] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "1db9255914a245a59bc20075d8d8dd55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } health_report { overall_health: UNKNOWN } } }
Aug 10 03:13:20 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331597, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.126@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:20.216437 31101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.201991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.18.112.126:44231)
0810 03:13:20.202869 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.202875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.202894 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:20.202935 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.202938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.202988 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.203071 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:20.204155 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.204897 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.206080 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.206471 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.206576 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.210308 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:20.210314 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:20.210318 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:20.210352 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:20.213732 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:20.214567 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:20.214571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:20.214573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:20.214697 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:20.215093 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:20.215096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:20.215098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:20.215362 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:20.215466 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.215988 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.216172 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":738,"thread_start_us":593,"threads_started":1}
I20260810 03:13:20.216782 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.201936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44231 (local address 127.0.0.1:56798)
0810 03:13:20.202592 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.202619 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.202784 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.203132 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.203137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.203765 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:20.204008 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.204019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.205019 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.205024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.205943 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.205954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.206617 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.206623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.206778 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.207446 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:20.207464 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:20.210042 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:20.213856 (+ 3814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:20.213869 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:20.213876 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:20.214459 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:20.214797 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:20.214802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:20.214806 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:20.214982 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:20.215489 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:20.215497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:20.215690 (+ 193us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.215912 (+ 222us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.216344 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":108,"thread_start_us":323,"threads_started":1}
I20260810 03:13:20.221637 30293 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:56798:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:13:20.222594 30293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:20.229444 30693 tablet_service.cc:1467] Processing CreateTablet for tablet 8636740f8c454141a1a7058a74ca1b84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c15ef195316c4e7cb51bb5559cd9bbdd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:13:20.230136 30693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8636740f8c454141a1a7058a74ca1b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.230300 30893 tablet_service.cc:1467] Processing CreateTablet for tablet 8636740f8c454141a1a7058a74ca1b84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c15ef195316c4e7cb51bb5559cd9bbdd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:13:20.230754 30893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8636740f8c454141a1a7058a74ca1b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.236266 31045 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: Bootstrap starting.
I20260810 03:13:20.229151 30493 tablet_service.cc:1467] Processing CreateTablet for tablet 8636740f8c454141a1a7058a74ca1b84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c15ef195316c4e7cb51bb5559cd9bbdd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:13:20.236886 30493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8636740f8c454141a1a7058a74ca1b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.237888 31045 tablet_bootstrap.cc:654] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.244033 31046 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: Bootstrap starting.
I20260810 03:13:20.245775 31046 tablet_bootstrap.cc:654] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.248099 31046 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: No bootstrap required, opened a new log
I20260810 03:13:20.248270 31046 ts_tablet_manager.cc:1397] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260810 03:13:20.249082 31046 raft_consensus.cc:348] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.249368 31046 raft_consensus.cc:374] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.249460 31046 raft_consensus.cc:729] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9117897b08784f6a85a556ea1f98fe1e, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.249670 31045 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: No bootstrap required, opened a new log
I20260810 03:13:20.249892 31045 ts_tablet_manager.cc:1397] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260810 03:13:20.249788 31046 consensus_queue.cc:260] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.250265 31061 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.250690 31061 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.250602 31045 raft_consensus.cc:348] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.250867 31045 raft_consensus.cc:374] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.250960 31045 raft_consensus.cc:729] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.251228 31045 consensus_queue.cc:260] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.251485 31046 ts_tablet_manager.cc:1428] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:13:20.251700 31057 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.252017 31057 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.252786 31047 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: Bootstrap starting.
I20260810 03:13:20.254547 31047 tablet_bootstrap.cc:654] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.259070 31045 ts_tablet_manager.cc:1428] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260810 03:13:20.260521 31047 tablet_bootstrap.cc:492] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: No bootstrap required, opened a new log
I20260810 03:13:20.260689 31047 ts_tablet_manager.cc:1397] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260810 03:13:20.261288 31047 raft_consensus.cc:348] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.261541 31047 raft_consensus.cc:374] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.261623 31047 raft_consensus.cc:729] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.261866 31047 consensus_queue.cc:260] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.262233 31055 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.262457 31047 ts_tablet_manager.cc:1428] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 03:13:20.262568 31055 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.347858 31057 raft_consensus.cc:482] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:20.348083 31057 raft_consensus.cc:504] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.349606 31057 leader_election.cc:288] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721), 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467)
I20260810 03:13:20.356778 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.350030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:36699 (local address 127.18.112.66:33467)
0810 03:13:20.350235 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.350242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.350810 (+ 568us) server_negotiation.cc:407] Connection header received
0810 03:13:20.351103 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.351110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.351197 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.351260 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:20.352014 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.352946 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.355094 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.355889 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.356028 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.356103 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.356372 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.356497 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:13:20.356778 31109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.349893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:33467 (local address 127.18.112.67:36699)
0810 03:13:20.350701 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.350722 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.350936 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.351441 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.351445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.351490 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:20.351790 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.351828 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.353145 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.353151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.354947 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.354960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.356040 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.356046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.356224 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.356249 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.356329 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.356449 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":1195,"threads_started":1}
I20260810 03:13:20.357625 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8636740f8c454141a1a7058a74ca1b84" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e" is_pre_election: true
I20260810 03:13:20.357928 30726 raft_consensus.cc:2454] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 0.
I20260810 03:13:20.358395 30828 leader_election.cc:302] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9117897b08784f6a85a556ea1f98fe1e, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:20.358645 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.350548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:39965 (local address 127.18.112.65:36721)
0810 03:13:20.350753 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.350759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.351460 (+ 701us) server_negotiation.cc:407] Connection header received
0810 03:13:20.351724 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.351731 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.351830 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.351927 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:20.352530 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.353659 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.356157 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.357374 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.357549 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.357804 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.358239 (+ 435us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.358374 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:13:20.358808 31057 raft_consensus.cc:2781] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:20.358928 31057 raft_consensus.cc:482] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:20.359007 31057 raft_consensus.cc:3037] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.359280 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.349976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:36721 (local address 127.18.112.67:39965)
0810 03:13:20.351340 (+ 1364us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.351358 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.351553 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.351954 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.351959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.351986 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:20.352360 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.352372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.353808 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.353814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.355967 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.355983 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.357614 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.357621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.358026 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.358069 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.358807 (+ 738us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.358902 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"spinlock_wait_cycles":75648,"thread_start_us":805,"threads_started":1}
I20260810 03:13:20.360112 30523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8636740f8c454141a1a7058a74ca1b84" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db9255914a245a59bc20075d8d8dd55" is_pre_election: true
I20260810 03:13:20.360428 30523 raft_consensus.cc:2454] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 0.
I20260810 03:13:20.361965 31057 raft_consensus.cc:504] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.362591 31057 leader_election.cc:288] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 election: Requested vote from peers 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721), 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467)
I20260810 03:13:20.362962 30523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8636740f8c454141a1a7058a74ca1b84" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db9255914a245a59bc20075d8d8dd55"
I20260810 03:13:20.363024 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8636740f8c454141a1a7058a74ca1b84" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e"
I20260810 03:13:20.363173 30523 raft_consensus.cc:3037] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.363238 30726 raft_consensus.cc:3037] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.366106 30726 raft_consensus.cc:2454] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 1.
I20260810 03:13:20.366127 30523 raft_consensus.cc:2454] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 1.
I20260810 03:13:20.366559 30825 leader_election.cc:302] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:20.366864 31057 raft_consensus.cc:2781] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:20.367240 31057 raft_consensus.cc:686] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 LEADER]: Becoming Leader. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Running, Role: LEADER
I20260810 03:13:20.367632 31057 consensus_queue.cc:237] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.369711 31110 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: TxnStatusTablet state changed. Reason: New leader afbe5fcd16054d6b9c44a5e22c474d7c. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.370064 31110 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:13:20.370731 31112 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:13:20.370946 31112 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:13:20.371342 30292 catalog_manager.cc:5495] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c reported cstate change: term changed from 0 to 1, leader changed from <none> to afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67). New cstate: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260810 03:13:20.400120 31115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.392127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38532 (local address 127.18.112.67:45829)
0810 03:13:20.392863 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.392869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.392893 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:13:20.392981 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.392986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.393088 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.393247 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:20.393668 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.395055 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.396968 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.397721 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.397896 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.398506 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.399277 (+ 771us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.399417 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.399563 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.399705 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":624,"threads_started":1}
I20260810 03:13:20.400219 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.392163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:45829 (local address 127.0.0.1:38532)
0810 03:13:20.392465 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.392485 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.392624 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.393273 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.393278 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.393291 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:13:20.393481 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.393497 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.395190 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.395196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.396808 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.396824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.397933 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.397939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.398186 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.398258 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.399413 (+ 1155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.399437 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.399522 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.399684 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260810 03:13:20.404510 30726 raft_consensus.cc:1261] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Refusing update from remote peer afbe5fcd16054d6b9c44a5e22c474d7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.404892 30523 raft_consensus.cc:1261] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Refusing update from remote peer afbe5fcd16054d6b9c44a5e22c474d7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.405282 31057 consensus_queue.cc:1035] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.405870 31057 consensus_queue.cc:1035] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.410885 31061 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: TxnStatusTablet state changed. Reason: New leader afbe5fcd16054d6b9c44a5e22c474d7c. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.411222 31061 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.412220 31055 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: TxnStatusTablet state changed. Reason: New leader afbe5fcd16054d6b9c44a5e22c474d7c. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.412487 31055 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.414418 31110 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.414693 31110 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:13:20.415819 31057 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.416142 31057 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P afbe5fcd16054d6b9c44a5e22c474d7c: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:13:20.418542 31055 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.418789 31055 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 1db9255914a245a59bc20075d8d8dd55: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.420074 31061 tablet_replica.cc:439] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } } }
I20260810 03:13:20.420303 31061 tablet_replica.cc:442] T 8636740f8c454141a1a7058a74ca1b84 P 9117897b08784f6a85a556ea1f98fe1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:13:20.436061 31115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.430746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:49751 (local address 127.18.112.67:45829)
0810 03:13:20.430927 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.430934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.431506 (+ 572us) server_negotiation.cc:407] Connection header received
0810 03:13:20.431709 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.431712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.431774 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.431890 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:20.432363 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.433100 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.434416 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.434872 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.434979 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.435363 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.435461 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.435539 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.435677 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.435750 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:13:20.436156 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.430747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:45829 (local address 127.18.112.65:49751)
0810 03:13:20.431391 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.431412 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.431588 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.431913 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.431918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.431929 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:13:20.432221 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.432231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.433224 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.433230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.434279 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.434292 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.435017 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.435023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.435154 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.435206 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.435562 (+ 356us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.435574 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.435639 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.435769 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":313,"threads_started":1}
I20260810 03:13:20.446311 30936 raft_consensus.cc:1261] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.446525 30726 raft_consensus.cc:1261] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.446844 31055 consensus_queue.cc:1035] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.447129 31065 consensus_queue.cc:1035] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.457096 31072 mvcc.cc:205] Tried to move back new op lower bound from 7316814235423801344 to 7316814234194857984. Current Snapshot: MvccSnapshot[applied={T|T < 7316814235423801344}]
I20260810 03:13:20.481262 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.475351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:46147 (local address 127.18.112.65:36721)
0810 03:13:20.475527 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.475533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.475671 (+ 138us) server_negotiation.cc:407] Connection header received
0810 03:13:20.475958 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.475963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.476044 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.476133 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:20.476784 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.477483 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.479590 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.480073 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.480167 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.480694 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.480796 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.480861 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.480995 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.481053 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:13:20.481560 31134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.474840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:36721 (local address 127.18.112.67:46147)
0810 03:13:20.475562 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:20.475583 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:20.475825 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:20.476167 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:20.476176 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:20.476189 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:13:20.476600 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.476619 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.477606 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.477612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.479426 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:20.479447 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.480252 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.480260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:20.480444 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.480533 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.480888 (+ 355us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.480898 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 03:13:20.480983 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 03:13:20.481130 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":696,"threads_started":1}
I20260810 03:13:20.513293 30293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:20.513562 30293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:20.516866 30293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Sending DeleteTablet for 3 replicas of tablet 3ee8e2e4ea754893a8a5f70694708858
I20260810 03:13:20.517539 30493 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38504
I20260810 03:13:20.517951 31082 tablet_replica.cc:330] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: stopping tablet replica
I20260810 03:13:20.517952 30693 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33310
I20260810 03:13:20.518165 31082 raft_consensus.cc:2229] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:20.518465 31082 raft_consensus.cc:2258] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.519199 30893 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee8e2e4ea754893a8a5f70694708858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38530
I20260810 03:13:20.519462 31081 tablet_replica.cc:330] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: stopping tablet replica
I20260810 03:13:20.519660 31081 raft_consensus.cc:2229] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:20.519865 31081 raft_consensus.cc:2258] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.520167 31082 ts_tablet_manager.cc:1905] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.524747 31081 ts_tablet_manager.cc:1905] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.530725 31141 tablet_replica.cc:330] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: stopping tablet replica
I20260810 03:13:20.530985 31141 raft_consensus.cc:2229] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:20.531271 31141 raft_consensus.cc:2258] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.540477 31141 ts_tablet_manager.cc:1905] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.544638 31081 ts_tablet_manager.cc:1918] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:20.545959 31082 ts_tablet_manager.cc:1918] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:20.546190 31081 log.cc:1196] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/3ee8e2e4ea754893a8a5f70694708858
I20260810 03:13:20.546716 31081 ts_tablet_manager.cc:1939] T 3ee8e2e4ea754893a8a5f70694708858 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting consensus metadata
I20260810 03:13:20.546897 31141 ts_tablet_manager.cc:1918] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:20.547031 31141 log.cc:1196] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/3ee8e2e4ea754893a8a5f70694708858
I20260810 03:13:20.547231 31082 log.cc:1196] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/3ee8e2e4ea754893a8a5f70694708858
I20260810 03:13:20.547427 31141 ts_tablet_manager.cc:1939] T 3ee8e2e4ea754893a8a5f70694708858 P 9117897b08784f6a85a556ea1f98fe1e: Deleting consensus metadata
I20260810 03:13:20.548369 30270 catalog_manager.cc:4841] TS afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829): tablet 3ee8e2e4ea754893a8a5f70694708858 (table test-table [id=1ca3542f3d6744018b753d97e292e392]) successfully deleted
I20260810 03:13:20.548369 30274 catalog_manager.cc:4841] TS 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467): tablet 3ee8e2e4ea754893a8a5f70694708858 (table test-table [id=1ca3542f3d6744018b753d97e292e392]) successfully deleted
I20260810 03:13:20.549010 31082 ts_tablet_manager.cc:1939] T 3ee8e2e4ea754893a8a5f70694708858 P 1db9255914a245a59bc20075d8d8dd55: Deleting consensus metadata
I20260810 03:13:20.549890 30271 catalog_manager.cc:4841] TS 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721): tablet 3ee8e2e4ea754893a8a5f70694708858 (table test-table [id=1ca3542f3d6744018b753d97e292e392]) successfully deleted
Aug 10 03:13:20 dist-test-slave-jlzn krb5kdc[30218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:13:20 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:20 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:13:20.593628 31101 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:20.583340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56802 (local address 127.18.112.126:44231)
0810 03:13:20.583540 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.583547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.583893 (+ 346us) server_negotiation.cc:407] Connection header received
0810 03:13:20.584064 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.584070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.584153 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.584273 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:20.585629 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.586789 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.588123 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.588773 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.588899 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.593377 (+ 4478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56802: BlockingRecv error: recv got EOF from 127.0.0.1:56802 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 03:13:20 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM
I20260810 03:13:20.610231 31101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.595957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.18.112.126:44231)
0810 03:13:20.596133 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.596139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.596392 (+ 253us) server_negotiation.cc:407] Connection header received
0810 03:13:20.596517 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.596522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.596592 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.596690 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:20.597852 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.598903 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.600242 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.600873 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.601018 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.604461 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:20.604467 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:20.604473 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:20.604511 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:20.607686 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:20.608333 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:20.608338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:20.608342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:20.608521 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:20.608828 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:20.608833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:20.608837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:20.609179 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:20.609434 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.609662 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.609883 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:13:20.613612 30293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:20.614326 30293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:20.621012 30493 tablet_service.cc:1467] Processing CreateTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da (DEFAULT_TABLE table=test-table [id=0ee0c68daf1746f2b828def896a290c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.621305 30893 tablet_service.cc:1467] Processing CreateTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da (DEFAULT_TABLE table=test-table [id=0ee0c68daf1746f2b828def896a290c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.621490 30493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520b3ea658d24bb2ad7fec0f6b51c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.621762 30893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520b3ea658d24bb2ad7fec0f6b51c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.625954 31047 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Bootstrap starting.
I20260810 03:13:20.626500 30693 tablet_service.cc:1467] Processing CreateTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da (DEFAULT_TABLE table=test-table [id=0ee0c68daf1746f2b828def896a290c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.626953 30693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520b3ea658d24bb2ad7fec0f6b51c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.627488 31047 tablet_bootstrap.cc:654] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.628456 31045 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Bootstrap starting.
I20260810 03:13:20.630036 31045 tablet_bootstrap.cc:654] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.634315 31046 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Bootstrap starting.
I20260810 03:13:20.635824 31047 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: No bootstrap required, opened a new log
I20260810 03:13:20.635860 31046 tablet_bootstrap.cc:654] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.635967 31047 ts_tablet_manager.cc:1397] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260810 03:13:20.636596 31047 raft_consensus.cc:348] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.636829 31047 raft_consensus.cc:374] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.636919 31047 raft_consensus.cc:729] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.637176 31047 consensus_queue.cc:260] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.637748 31047 ts_tablet_manager.cc:1428] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 03:13:20.639505 31046 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: No bootstrap required, opened a new log
I20260810 03:13:20.639640 31046 ts_tablet_manager.cc:1397] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260810 03:13:20.640317 31046 raft_consensus.cc:348] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.640560 31046 raft_consensus.cc:374] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.640657 31046 raft_consensus.cc:729] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9117897b08784f6a85a556ea1f98fe1e, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.640905 31046 consensus_queue.cc:260] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.642354 31046 ts_tablet_manager.cc:1428] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:13:20.644647 31045 tablet_bootstrap.cc:492] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: No bootstrap required, opened a new log
I20260810 03:13:20.644798 31045 ts_tablet_manager.cc:1397] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.006s
I20260810 03:13:20.645517 31045 raft_consensus.cc:348] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.645752 31045 raft_consensus.cc:374] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.645838 31045 raft_consensus.cc:729] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.646044 31045 consensus_queue.cc:260] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.646556 31045 ts_tablet_manager.cc:1428] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 03:13:20.726640 31129 raft_consensus.cc:482] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:20.726899 31129 raft_consensus.cc:504] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.727777 31129 leader_election.cc:288] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:20.728416 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520b3ea658d24bb2ad7fec0f6b51c7da" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" is_pre_election: true
I20260810 03:13:20.728431 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520b3ea658d24bb2ad7fec0f6b51c7da" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e" is_pre_election: true
I20260810 03:13:20.728706 30726 raft_consensus.cc:2454] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:20.728715 30936 raft_consensus.cc:2454] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 0.
I20260810 03:13:20.729171 30426 leader_election.cc:302] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, 9117897b08784f6a85a556ea1f98fe1e; no voters:
I20260810 03:13:20.729481 31129 raft_consensus.cc:2781] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:20.729640 31129 raft_consensus.cc:482] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:20.729733 31129 raft_consensus.cc:3037] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.731976 31129 raft_consensus.cc:504] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.732507 31129 leader_election.cc:288] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Requested vote from peers 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467), afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829)
I20260810 03:13:20.732940 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520b3ea658d24bb2ad7fec0f6b51c7da" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e"
I20260810 03:13:20.733026 30936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520b3ea658d24bb2ad7fec0f6b51c7da" candidate_uuid: "1db9255914a245a59bc20075d8d8dd55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c"
I20260810 03:13:20.733170 30726 raft_consensus.cc:3037] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.733223 30936 raft_consensus.cc:3037] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:20.735332 30936 raft_consensus.cc:2454] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:20.735790 30418 leader_election.cc:302] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:20.736167 30726 raft_consensus.cc:2454] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1db9255914a245a59bc20075d8d8dd55 in term 1.
I20260810 03:13:20.736331 31129 raft_consensus.cc:2781] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:20.736598 31129 raft_consensus.cc:686] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Becoming Leader. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Running, Role: LEADER
I20260810 03:13:20.737073 31129 consensus_queue.cc:237] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.739670 30292 catalog_manager.cc:5495] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "1db9255914a245a59bc20075d8d8dd55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } health_report { overall_health: UNKNOWN } } }
I20260810 03:13:20.770058 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:20.765088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38520 (local address 127.18.112.65:36721)
0810 03:13:20.765281 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:20.765288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:20.765419 (+ 131us) server_negotiation.cc:407] Connection header received
0810 03:13:20.765630 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:20.765634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:20.765707 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:20.765777 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:20.766257 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.766997 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.768375 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:20.768873 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:20.768985 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:20.769406 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:20.769504 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:20.769577 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:20.769715 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 03:13:20.769790 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:13:20.772617 30936 raft_consensus.cc:1261] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.772699 30726 raft_consensus.cc:1261] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Refusing update from remote peer 1db9255914a245a59bc20075d8d8dd55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:20.773267 31065 consensus_queue.cc:1035] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.773797 31129 consensus_queue.cc:1035] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:20.785207 30293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:20.785447 30293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:20.788597 30293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Sending DeleteTablet for 3 replicas of tablet 520b3ea658d24bb2ad7fec0f6b51c7da
I20260810 03:13:20.789619 30493 tablet_service.cc:1514] Processing DeleteTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38504
I20260810 03:13:20.789640 30893 tablet_service.cc:1514] Processing DeleteTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38530
I20260810 03:13:20.789870 31082 tablet_replica.cc:330] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: stopping tablet replica
I20260810 03:13:20.789920 31081 tablet_replica.cc:330] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: stopping tablet replica
I20260810 03:13:20.790036 31082 raft_consensus.cc:2229] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:20.790112 31081 raft_consensus.cc:2229] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:20.790337 31081 raft_consensus.cc:2258] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.790372 31082 raft_consensus.cc:2258] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.791215 31081 ts_tablet_manager.cc:1905] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.791327 31082 ts_tablet_manager.cc:1905] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.792162 30693 tablet_service.cc:1514] Processing DeleteTablet for tablet 520b3ea658d24bb2ad7fec0f6b51c7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:20 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33310
I20260810 03:13:20.792579 31141 tablet_replica.cc:330] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: stopping tablet replica
I20260810 03:13:20.792845 31141 raft_consensus.cc:2229] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:20.793092 31141 pending_rounds.cc:62] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Trying to abort 2 pending ops.
I20260810 03:13:20.793292 31141 pending_rounds.cc:68] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316814236758913024 op_type: WRITE_OP write_request { tablet_id: "520b3ea658d24bb2ad7fec0f6b51c7da" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\374\205\345\323\006\"8\n\ntest-admin\022*\n 0ee0c68daf1746f2b828def896a290c2\020\001\030\001 \001(\001" signature: "<redacted>""\007y\256\207\001\231\010\304=K5\332\25514Q\367\300^\026s\'\276\215\335\303HtL\201\023\211\3315K\211\202\300\370\347\224\201\303r\242\300\206\267\353\216\337\261\010\021:\362\272\n\336\030\254\366\221\356" signing_key_seq_num: 0 } } request_id { client_id: "9603939998c04b4390c45dea24b719c4" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260810 03:13:20.794049 31141 pending_rounds.cc:68] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316814236621160448 op_type: NO_OP noop_request { }
I20260810 03:13:20.794199 31141 raft_consensus.cc:2866] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 03:13:20.794312 31141 raft_consensus.cc:2258] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:20.794914 30293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:20.795558 30293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:20.798370 31141 ts_tablet_manager.cc:1905] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:20.803160 30693 tablet_service.cc:1467] Processing CreateTablet for tablet 75faf9b95d1e418a986f55315b949f86 (DEFAULT_TABLE table=test-table [id=c3d40addbc434c3f839fc5c00895ea44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.803591 30693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75faf9b95d1e418a986f55315b949f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.803575 31081 ts_tablet_manager.cc:1918] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.803848 31081 log.cc:1196] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/520b3ea658d24bb2ad7fec0f6b51c7da
I20260810 03:13:20.804407 31081 ts_tablet_manager.cc:1939] T 520b3ea658d24bb2ad7fec0f6b51c7da P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting consensus metadata
I20260810 03:13:20.805056 31141 ts_tablet_manager.cc:1918] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.805240 31141 log.cc:1196] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/520b3ea658d24bb2ad7fec0f6b51c7da
I20260810 03:13:20.805670 31141 ts_tablet_manager.cc:1939] T 520b3ea658d24bb2ad7fec0f6b51c7da P 9117897b08784f6a85a556ea1f98fe1e: Deleting consensus metadata
I20260810 03:13:20.806775 30274 catalog_manager.cc:4841] TS 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467): tablet 520b3ea658d24bb2ad7fec0f6b51c7da (table test-table [id=0ee0c68daf1746f2b828def896a290c2]) successfully deleted
I20260810 03:13:20.808022 30270 catalog_manager.cc:4841] TS afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829): tablet 520b3ea658d24bb2ad7fec0f6b51c7da (table test-table [id=0ee0c68daf1746f2b828def896a290c2]) successfully deleted
I20260810 03:13:20.808425 30893 tablet_service.cc:1467] Processing CreateTablet for tablet 75faf9b95d1e418a986f55315b949f86 (DEFAULT_TABLE table=test-table [id=c3d40addbc434c3f839fc5c00895ea44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.808801 30893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75faf9b95d1e418a986f55315b949f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.812314 30493 tablet_service.cc:1467] Processing CreateTablet for tablet 75faf9b95d1e418a986f55315b949f86 (DEFAULT_TABLE table=test-table [id=c3d40addbc434c3f839fc5c00895ea44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:20.812767 30493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75faf9b95d1e418a986f55315b949f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:20.814046 31046 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Bootstrap starting.
I20260810 03:13:20.814478 31082 ts_tablet_manager.cc:1918] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:20.814661 31082 log.cc:1196] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/520b3ea658d24bb2ad7fec0f6b51c7da
I20260810 03:13:20.815130 31082 ts_tablet_manager.cc:1939] T 520b3ea658d24bb2ad7fec0f6b51c7da P 1db9255914a245a59bc20075d8d8dd55: Deleting consensus metadata
I20260810 03:13:20.815565 31046 tablet_bootstrap.cc:654] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.816591 30271 catalog_manager.cc:4841] TS 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721): tablet 520b3ea658d24bb2ad7fec0f6b51c7da (table test-table [id=0ee0c68daf1746f2b828def896a290c2]) successfully deleted
I20260810 03:13:20.817144 31045 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Bootstrap starting.
I20260810 03:13:20.818343 31045 tablet_bootstrap.cc:654] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.819289 31047 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Bootstrap starting.
I20260810 03:13:20.820812 31047 tablet_bootstrap.cc:654] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:20.821135 31046 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: No bootstrap required, opened a new log
I20260810 03:13:20.821349 31046 ts_tablet_manager.cc:1397] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260810 03:13:20.823284 31046 raft_consensus.cc:348] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.823637 31046 raft_consensus.cc:374] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.823760 31046 raft_consensus.cc:729] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9117897b08784f6a85a556ea1f98fe1e, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.824133 31046 consensus_queue.cc:260] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.828299 31046 ts_tablet_manager.cc:1428] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260810 03:13:20.832831 31047 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: No bootstrap required, opened a new log
I20260810 03:13:20.832998 31047 ts_tablet_manager.cc:1397] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.005s
I20260810 03:13:20.833504 31045 tablet_bootstrap.cc:492] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: No bootstrap required, opened a new log
I20260810 03:13:20.833681 31045 ts_tablet_manager.cc:1397] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.014s
I20260810 03:13:20.833732 31047 raft_consensus.cc:348] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.833977 31047 raft_consensus.cc:374] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.834061 31047 raft_consensus.cc:729] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1db9255914a245a59bc20075d8d8dd55, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.834303 31047 consensus_queue.cc:260] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.834554 31045 raft_consensus.cc:348] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.834807 31047 ts_tablet_manager.cc:1428] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 03:13:20.834800 31045 raft_consensus.cc:374] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:20.834884 31045 raft_consensus.cc:729] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Initialized, Role: FOLLOWER
I20260810 03:13:20.835148 31045 consensus_queue.cc:260] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:20.835628 31045 ts_tablet_manager.cc:1428] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 03:13:21.038689 31124 raft_consensus.cc:482] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:21.038878 31124 raft_consensus.cc:504] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:21.039438 31124 leader_election.cc:288] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721), 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467)
I20260810 03:13:21.039958 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75faf9b95d1e418a986f55315b949f86" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e" is_pre_election: true
I20260810 03:13:21.039978 30523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75faf9b95d1e418a986f55315b949f86" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db9255914a245a59bc20075d8d8dd55" is_pre_election: true
I20260810 03:13:21.040175 30726 raft_consensus.cc:2454] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 0.
I20260810 03:13:21.040195 30523 raft_consensus.cc:2454] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 0.
I20260810 03:13:21.040589 30825 leader_election.cc:302] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:21.040889 31124 raft_consensus.cc:2781] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:21.041009 31124 raft_consensus.cc:482] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:21.041101 31124 raft_consensus.cc:3037] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:21.043155 31124 raft_consensus.cc:504] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:21.043699 31124 leader_election.cc:288] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 election: Requested vote from peers 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721), 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467)
I20260810 03:13:21.044127 30523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75faf9b95d1e418a986f55315b949f86" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1db9255914a245a59bc20075d8d8dd55"
I20260810 03:13:21.044185 30726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75faf9b95d1e418a986f55315b949f86" candidate_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9117897b08784f6a85a556ea1f98fe1e"
I20260810 03:13:21.044292 30523 raft_consensus.cc:3037] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:21.044363 30726 raft_consensus.cc:3037] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:21.046116 30523 raft_consensus.cc:2454] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 1.
I20260810 03:13:21.046437 30726 raft_consensus.cc:2454] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbe5fcd16054d6b9c44a5e22c474d7c in term 1.
I20260810 03:13:21.046483 30825 leader_election.cc:302] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1db9255914a245a59bc20075d8d8dd55, afbe5fcd16054d6b9c44a5e22c474d7c; no voters:
I20260810 03:13:21.046912 31124 raft_consensus.cc:2781] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:21.047245 31124 raft_consensus.cc:686] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 LEADER]: Becoming Leader. State: Replica: afbe5fcd16054d6b9c44a5e22c474d7c, State: Running, Role: LEADER
I20260810 03:13:21.047497 31124 consensus_queue.cc:237] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } }
I20260810 03:13:21.049832 30292 catalog_manager.cc:5495] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c reported cstate change: term changed from 0 to 1, leader changed from <none> to afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67). New cstate: current_term: 1 leader_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afbe5fcd16054d6b9c44a5e22c474d7c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 45829 } health_report { overall_health: HEALTHY } } }
I20260810 03:13:21.070114 31183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.064951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38536 (local address 127.18.112.67:45829)
0810 03:13:21.065437 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:21.065442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:21.065456 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:13:21.065504 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:21.065507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:21.065562 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:21.065641 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:21.066036 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.066789 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.068702 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.069090 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.069187 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.069529 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:21.069618 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:21.069676 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:21.069758 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 03:13:21.069813 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":300,"threads_started":1}
I20260810 03:13:21.081408 31183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.077151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41871 (local address 127.18.112.67:45829)
0810 03:13:21.077326 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:21.077332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:21.077658 (+ 326us) server_negotiation.cc:407] Connection header received
0810 03:13:21.077789 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:21.077792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:21.077848 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:21.077906 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:21.078244 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.078901 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.080123 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.080498 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.080584 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.080889 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:21.080971 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:21.081028 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:21.081135 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 03:13:21.081189 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:13:21.081506 31186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.077106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:45829 (local address 127.18.112.67:41871)
0810 03:13:21.077574 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:21.077589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:21.077694 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:21.077922 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:21.077925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:21.077933 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:13:21.078126 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:21.078133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.079004 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.079007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:21.080015 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:21.080026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.080626 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.080631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:21.080738 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.080771 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:13:21.081046 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:13:21.081054 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 03:13:21.081108 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 03:13:21.081208 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":254,"threads_started":1}
I20260810 03:13:21.088065 30726 raft_consensus.cc:1261] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Refusing update from remote peer afbe5fcd16054d6b9c44a5e22c474d7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:21.088119 30523 raft_consensus.cc:1261] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Refusing update from remote peer afbe5fcd16054d6b9c44a5e22c474d7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:21.088619 31177 consensus_queue.cc:1035] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9117897b08784f6a85a556ea1f98fe1e" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:21.088886 31124 consensus_queue.cc:1035] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1db9255914a245a59bc20075d8d8dd55" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:21.140898 30292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:21.141131 30292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:21.143826 30292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a2c9a9517164277abf60da17a063dab: Sending DeleteTablet for 3 replicas of tablet 75faf9b95d1e418a986f55315b949f86
I20260810 03:13:21.144574 30493 tablet_service.cc:1514] Processing DeleteTablet for tablet 75faf9b95d1e418a986f55315b949f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:21 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38504
I20260810 03:13:21.144583 30693 tablet_service.cc:1514] Processing DeleteTablet for tablet 75faf9b95d1e418a986f55315b949f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:21 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33310
I20260810 03:13:21.144863 31082 tablet_replica.cc:330] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: stopping tablet replica
I20260810 03:13:21.144966 31141 tablet_replica.cc:330] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: stopping tablet replica
I20260810 03:13:21.145063 31082 raft_consensus.cc:2229] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:21.145165 31141 raft_consensus.cc:2229] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:21.145257 31082 raft_consensus.cc:2258] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:21.145365 31141 raft_consensus.cc:2258] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:21.146265 31082 ts_tablet_manager.cc:1905] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:21.146456 31141 ts_tablet_manager.cc:1905] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:21.147411 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 30391
I20260810 03:13:21.150338 30892 tablet_service.cc:1514] Processing DeleteTablet for tablet 75faf9b95d1e418a986f55315b949f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:21 UTC) from {username='oryx', principal='oryx/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38530
I20260810 03:13:21.150626 31081 tablet_replica.cc:330] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: stopping tablet replica
I20260810 03:13:21.150868 31081 raft_consensus.cc:2229] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:21.151373 31081 raft_consensus.cc:2258] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:21.153621 31082 ts_tablet_manager.cc:1918] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:21.153661 31081 ts_tablet_manager.cc:1905] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:21.153874 31082 log.cc:1196] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/75faf9b95d1e418a986f55315b949f86
I20260810 03:13:21.154364 31082 ts_tablet_manager.cc:1939] T 75faf9b95d1e418a986f55315b949f86 P 1db9255914a245a59bc20075d8d8dd55: Deleting consensus metadata
I20260810 03:13:21.155454 30271 catalog_manager.cc:4841] TS 1db9255914a245a59bc20075d8d8dd55 (127.18.112.65:36721): tablet 75faf9b95d1e418a986f55315b949f86 (table test-table [id=c3d40addbc434c3f839fc5c00895ea44]) successfully deleted
I20260810 03:13:21.160624 31081 ts_tablet_manager.cc:1918] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:21.160792 31081 log.cc:1196] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/75faf9b95d1e418a986f55315b949f86
I20260810 03:13:21.161185 31081 ts_tablet_manager.cc:1939] T 75faf9b95d1e418a986f55315b949f86 P afbe5fcd16054d6b9c44a5e22c474d7c: Deleting consensus metadata
I20260810 03:13:21.161659 31141 ts_tablet_manager.cc:1918] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:13:21.161787 31141 log.cc:1196] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/75faf9b95d1e418a986f55315b949f86
I20260810 03:13:21.162207 31141 ts_tablet_manager.cc:1939] T 75faf9b95d1e418a986f55315b949f86 P 9117897b08784f6a85a556ea1f98fe1e: Deleting consensus metadata
I20260810 03:13:21.162212 30270 catalog_manager.cc:4841] TS afbe5fcd16054d6b9c44a5e22c474d7c (127.18.112.67:45829): tablet 75faf9b95d1e418a986f55315b949f86 (table test-table [id=c3d40addbc434c3f839fc5c00895ea44]) successfully deleted
I20260810 03:13:21.163147 30274 catalog_manager.cc:4841] TS 9117897b08784f6a85a556ea1f98fe1e (127.18.112.66:33467): tablet 75faf9b95d1e418a986f55315b949f86 (table test-table [id=c3d40addbc434c3f839fc5c00895ea44]) successfully deleted
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.65@KRBTEST.COM
I20260810 03:13:21.177395 31042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.148316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38522 (local address 127.18.112.65:36721)
0810 03:13:21.148484 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:21.148490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:21.158729 (+ 10239us) server_negotiation.cc:407] Connection header received
0810 03:13:21.158898 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:21.158904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:21.158985 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:21.159093 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:21.161091 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.162223 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.164225 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.164625 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.164725 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.171861 (+ 7136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:21.171880 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:21.171902 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:21.171940 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:21.174772 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.175400 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.175407 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.175409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.175541 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.175932 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.175936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.175938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.176303 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:21.176590 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:21.176906 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 03:13:21.177117 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:13:21.177961 30590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:21.340691 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 30391
I20260810 03:13:21.380968 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 30602
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.66@KRBTEST.COM
I20260810 03:13:21.396430 31196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.381715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33312 (local address 127.18.112.66:33467)
0810 03:13:21.382469 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:21.382473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:21.382488 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:13:21.382542 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:21.382546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:21.382605 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:21.382697 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:21.384319 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.385006 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.386222 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.386635 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.386754 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.391004 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:21.391017 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:21.391032 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:21.391071 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:21.393804 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.394437 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.394445 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.394447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.394576 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.394920 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.394924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.394926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.395278 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:21.395555 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:21.395893 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 03:13:21.396106 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":541,"threads_started":1}
I20260810 03:13:21.397091 30780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:21.529042 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 30602
I20260810 03:13:21.559511 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 30794
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[30218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.112.67@KRBTEST.COM
I20260810 03:13:21.578634 31183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:21.560324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38550 (local address 127.18.112.67:45829)
0810 03:13:21.560530 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:21.560536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:21.560658 (+ 122us) server_negotiation.cc:407] Connection header received
0810 03:13:21.560864 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:21.560869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:21.560954 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:21.561060 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:21.562609 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.563768 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.565676 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:21.566433 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:21.566579 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:21.571870 (+ 5291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:21.571890 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:21.571913 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:21.571953 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:21.575747 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.576407 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.576416 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.576419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.576619 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:21.577145 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:21.577150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:21.577154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:21.577587 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:21.577863 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:21.578030 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 03:13:21.578244 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:13:21.579401 30995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:21.731637 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 30794
I20260810 03:13:21.760020 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 30245
I20260810 03:13:21.761118 30352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:21.874325 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 30245
2026-08-10T03:13:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5795 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[31209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[31209](info): set up 2 sockets
Aug 10 03:13:21 dist-test-slave-jlzn krb5kdc[31209](info): commencing operation
krb5kdc: starting...
W20260810 03:13:23.058625 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:23 dist-test-slave-jlzn krb5kdc[31209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:13:23.268970 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36573
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:45345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:36573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:23.576907 31234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:23.577196 31234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:23.577327 31234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:23.584209 31234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:23.584319 31234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:23.584393 31234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:23.584467 31234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:23.584542 31234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:23.593776 31234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:45345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:36573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:23.594933 31234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:23.596189 31234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:23.607052 31239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:23.607085 31243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:23.607069 31241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:23.607853 31234 server_base.cc:1034] running on GCE node
I20260810 03:13:23.608577 31234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:23.609819 31234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:23.611030 31234 hybrid_clock.cc:648] HybridClock initialized: now 1786331603610981 us; error 29 us; skew 500 ppm
I20260810 03:13:23.611344 31234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T03:13:23Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1805 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:23 dist-test-slave-jlzn krb5kdc[31251](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:23 dist-test-slave-jlzn krb5kdc[31251](info): set up 2 sockets
Aug 10 03:13:23 dist-test-slave-jlzn krb5kdc[31251](info): commencing operation
krb5kdc: starting...
W20260810 03:13:24.868963 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:25 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:13:25.080696 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43623
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:43623
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:25.389792 31267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:25.390065 31267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:25.390199 31267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:25.397182 31267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:25.397301 31267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:25.397377 31267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:25.397459 31267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:25.397519 31267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:25.406733 31267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:43623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:25.407920 31267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:25.409178 31267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:25.419950 31274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:25.419997 31281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:25.419970 31273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:25.420732 31267 server_base.cc:1034] running on GCE node
I20260810 03:13:25.421489 31267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:25.422703 31267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:25.423885 31267 hybrid_clock.cc:648] HybridClock initialized: now 1786331605423832 us; error 40 us; skew 500 ppm
I20260810 03:13:25.424186 31267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:25 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:25.427070 31267 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:13:25.428424 31267 webserver.cc:460] Webserver started at http://127.18.112.126:34487/ using document root <none> and password file <none>
I20260810 03:13:25.429052 31267 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:25.429167 31267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:25.429448 31267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:25.432387 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "cdafbf31d87142d8a46366a43bdaa102"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "d94f38e9d569a15ccb6e79229889acea"
server_key_iv: "e9c2c2eceb0e86b91ff470b416a4bfc4"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.433112 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "cdafbf31d87142d8a46366a43bdaa102"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "d94f38e9d569a15ccb6e79229889acea"
server_key_iv: "e9c2c2eceb0e86b91ff470b416a4bfc4"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.437812 31267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:25.440918 31292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:25.442095 31267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:25.442246 31267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "cdafbf31d87142d8a46366a43bdaa102"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "d94f38e9d569a15ccb6e79229889acea"
server_key_iv: "e9c2c2eceb0e86b91ff470b416a4bfc4"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.442409 31267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:25.456512 31267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:25.460367 31267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:25.460614 31267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:25.477439 31267 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:43623
I20260810 03:13:25.477461 31373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:43623 every 8 connection(s)
I20260810 03:13:25.478760 31267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:25.482213 31374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:25.487342 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 31267
I20260810 03:13:25.487560 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:25.488401 18881 external_mini_cluster.cc:1428] Setting key f36512c3ff438b76e1445308b2a386c0
I20260810 03:13:25.493088 31374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Bootstrap starting.
I20260810 03:13:25.496531 31374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:25.497710 31374 log.cc:824] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:25.500763 31374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: No bootstrap required, opened a new log
Aug 10 03:13:25 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:25.508625 31374 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:25.508960 31374 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:25.509068 31374 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdafbf31d87142d8a46366a43bdaa102, State: Initialized, Role: FOLLOWER
I20260810 03:13:25.509639 31374 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:25.509865 31374 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:25.509995 31374 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:25.510159 31374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:25.510690 31377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:25.490348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.18.112.126:43623)
0810 03:13:25.491106 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:25.491116 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:25.491161 (+ 45us) server_negotiation.cc:407] Connection header received
0810 03:13:25.492861 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:25.492881 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:25.493235 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:25.493545 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:25.495336 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:25.496654 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:25.498343 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:25.499221 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:25.499344 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:25.503705 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:25.503713 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:25.503729 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:25.503762 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:25.506710 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:25.507307 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:25.507313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:25.507318 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:25.507491 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:25.507873 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:25.507877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:25.507879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:25.508477 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:25.508758 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:25.509213 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 03:13:25.509632 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":360,"threads_started":1}
I20260810 03:13:25.512827 31374 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:25.513309 31374 leader_election.cc:302] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdafbf31d87142d8a46366a43bdaa102; no voters:
I20260810 03:13:25.513896 31374 leader_election.cc:288] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:25.513999 31380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:25.514597 31380 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 LEADER]: Becoming Leader. State: Replica: cdafbf31d87142d8a46366a43bdaa102, State: Running, Role: LEADER
I20260810 03:13:25.515060 31380 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:25.515645 31374 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:25.517598 31382 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdafbf31d87142d8a46366a43bdaa102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } } }
I20260810 03:13:25.517974 31382 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:25.517624 31383 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdafbf31d87142d8a46366a43bdaa102. Latest consensus state: current_term: 1 leader_uuid: "cdafbf31d87142d8a46366a43bdaa102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } } }
I20260810 03:13:25.521795 31383 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:25.522725 31393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:25.527245 31393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:25.534538 31393 catalog_manager.cc:1347] Generated new cluster ID: 427936caf4bc4f88830f3e4af97f1736
I20260810 03:13:25.534636 31393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:25.552083 31393 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:25.553221 31393 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:25.561046 31393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Generated new TSK 0
I20260810 03:13:25.561771 31393 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:13:25.619506 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:25.929497 31417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:25.929752 31417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:25.929880 31417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:25.936718 31417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:25.936820 31417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:25.936972 31417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:25.946182 31417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:25.947324 31417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:25.948549 31417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:25.960608 31425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:25.960656 31428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:25.960690 31426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:25.961621 31417 server_base.cc:1034] running on GCE node
I20260810 03:13:25.962116 31417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:25.962936 31417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:25.964123 31417 hybrid_clock.cc:648] HybridClock initialized: now 1786331605964082 us; error 28 us; skew 500 ppm
I20260810 03:13:25.964380 31417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:25 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:25.967267 31417 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:13:25.968631 31417 webserver.cc:460] Webserver started at http://127.18.112.65:44099/ using document root <none> and password file <none>
I20260810 03:13:25.969213 31417 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:25.969306 31417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:25.969559 31417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:25.972280 31417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "2ab7ae3ed0cb4834919b2487869376b3"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "7b1cd59d6512d6619549a27ae830a185"
server_key_iv: "eea11a776e9f07c27317366cbe0ff234"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.972990 31417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "2ab7ae3ed0cb4834919b2487869376b3"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "7b1cd59d6512d6619549a27ae830a185"
server_key_iv: "eea11a776e9f07c27317366cbe0ff234"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.977644 31417 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:25.980724 31435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:25.981889 31417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:25.982018 31417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "2ab7ae3ed0cb4834919b2487869376b3"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "7b1cd59d6512d6619549a27ae830a185"
server_key_iv: "eea11a776e9f07c27317366cbe0ff234"
server_key_version: "encryptionkey@0"
I20260810 03:13:25.982169 31417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:25.999953 31417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:26.003297 31417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:26.003515 31417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:26.004386 31417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:26.005577 31417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:26.005648 31417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.005736 31417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:26.005782 31417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.035079 31417 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:36785
I20260810 03:13:26.035122 31605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:36785 every 8 connection(s)
I20260810 03:13:26.036283 31417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:26.038981 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 31417
I20260810 03:13:26.039177 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:26.039821 18881 external_mini_cluster.cc:1428] Setting key 5136ffb74f38fc4bbf638850c21a8baf
Aug 10 03:13:26 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:26.055769 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:26.038563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:57317 (local address 127.18.112.126:43623)
0810 03:13:26.039041 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:26.039048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:26.040015 (+ 967us) server_negotiation.cc:407] Connection header received
0810 03:13:26.042191 (+ 2176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:26.042197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:26.042274 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:26.042390 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:26.043749 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.044736 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.046230 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.046732 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.046866 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:26.050173 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:26.050179 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:26.050183 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:26.050220 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:26.052966 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:26.053746 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:26.053749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:26.053751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:26.053858 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:26.054273 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:26.054276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:26.054277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:26.054526 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:26.054629 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:26.055363 (+ 734us) server_negotiation.cc:299] Negotiation successful
0810 03:13:26.055519 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":236,"threads_started":1}
I20260810 03:13:26.057061 31609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:26.039024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:57317)
0810 03:13:26.039842 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:26.039889 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:26.041943 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:26.042550 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:26.042557 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:26.043049 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:26.043571 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:26.043588 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.044860 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.044864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:26.046091 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:26.046103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.046932 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.046937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:26.047120 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:26.047723 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:26.047750 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:26.049976 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:26.053097 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:26.053105 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:26.053118 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:26.053653 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:26.053942 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:26.053947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:26.053951 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:26.054171 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:26.054662 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:26.054669 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:26.055029 (+ 360us) client_negotiation.cc:769] Sending connection context
0810 03:13:26.055310 (+ 281us) client_negotiation.cc:240] Negotiation successful
0810 03:13:26.055778 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":289,"threads_started":1}
I20260810 03:13:26.058450 31606 heartbeater.cc:347] Connected to a master server at 127.18.112.126:43623
I20260810 03:13:26.058722 31606 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:26.059376 31606 heartbeater.cc:511] Master 127.18.112.126:43623 requested a full tablet report, sending...
I20260810 03:13:26.061463 31318 ts_manager.cc:194] Registered new tserver with Master: 2ab7ae3ed0cb4834919b2487869376b3 (127.18.112.65:36785)
I20260810 03:13:26.062912 31318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:57317
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:13:26.090723 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:26.400264 31614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:26.400516 31614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:26.400614 31614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:26.407379 31614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:26.407495 31614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:26.407608 31614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:26.416746 31614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:26.417790 31614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:26.418967 31614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:26.430897 31621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:26.430971 31620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:26.430940 31623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:26.431612 31614 server_base.cc:1034] running on GCE node
I20260810 03:13:26.432216 31614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:26.433785 31614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:26.434978 31614 hybrid_clock.cc:648] HybridClock initialized: now 1786331606434931 us; error 42 us; skew 500 ppm
I20260810 03:13:26.435256 31614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:26 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331606, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:26.440495 31614 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:13:26.441820 31614 webserver.cc:460] Webserver started at http://127.18.112.66:34971/ using document root <none> and password file <none>
I20260810 03:13:26.442430 31614 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:26.442538 31614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:26.442826 31614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:26.445569 31614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "07f75b6f079f423aa159757a4c1cddb5"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "6b1918aa70cc7592834324718f9f38c9"
server_key_iv: "b5d5d313b58403724c15fd8ec543b937"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.446310 31614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "07f75b6f079f423aa159757a4c1cddb5"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "6b1918aa70cc7592834324718f9f38c9"
server_key_iv: "b5d5d313b58403724c15fd8ec543b937"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.451074 31614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:13:26.454252 31633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.455456 31614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:26.455605 31614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "07f75b6f079f423aa159757a4c1cddb5"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "6b1918aa70cc7592834324718f9f38c9"
server_key_iv: "b5d5d313b58403724c15fd8ec543b937"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.455782 31614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:26.483604 31614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:26.487613 31614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:26.487916 31614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:26.488940 31614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:26.490228 31614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:26.490299 31614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.490407 31614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:26.490464 31614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.520272 31614 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:42853
I20260810 03:13:26.520356 31802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:42853 every 8 connection(s)
I20260810 03:13:26.521435 31614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:26.528374 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 31614
I20260810 03:13:26.528558 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:26.528975 18881 external_mini_cluster.cc:1428] Setting key 413332805ae65fb8a9690e5ba5b512e3
Aug 10 03:13:26 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331606, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:26.540642 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:26.523753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52015 (local address 127.18.112.126:43623)
0810 03:13:26.523953 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:26.523957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:26.525014 (+ 1057us) server_negotiation.cc:407] Connection header received
0810 03:13:26.526749 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:26.526755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:26.526832 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:26.526920 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:26.528518 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.529341 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.531220 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.531635 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.531734 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:26.535465 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:26.535470 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:26.535473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:26.535503 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:26.537880 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:26.538621 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:26.538625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:26.538627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:26.538757 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:26.539169 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:26.539172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:26.539174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:26.539404 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:26.539506 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:26.540241 (+ 735us) server_negotiation.cc:299] Negotiation successful
0810 03:13:26.540411 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 03:13:26.541616 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:26.524198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:52015)
0810 03:13:26.524859 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:26.524904 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:26.526495 (+ 1591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:26.527156 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:26.527164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:26.527639 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:26.528323 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:26.528350 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.529492 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.529496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:26.531067 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:26.531082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:26.531867 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:26.531874 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:26.532128 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:26.532782 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:26.532810 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:26.535254 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:26.538006 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:26.538014 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:26.538027 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:26.538525 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:26.538848 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:26.538852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:26.538855 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:26.539078 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:26.539506 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:26.539513 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:26.539888 (+ 375us) client_negotiation.cc:769] Sending connection context
0810 03:13:26.540148 (+ 260us) client_negotiation.cc:240] Negotiation successful
0810 03:13:26.540584 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":260,"threads_started":1}
I20260810 03:13:26.542971 31805 heartbeater.cc:347] Connected to a master server at 127.18.112.126:43623
I20260810 03:13:26.543229 31805 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:26.543895 31805 heartbeater.cc:511] Master 127.18.112.126:43623 requested a full tablet report, sending...
I20260810 03:13:26.545182 31318 ts_manager.cc:194] Registered new tserver with Master: 07f75b6f079f423aa159757a4c1cddb5 (127.18.112.66:42853)
I20260810 03:13:26.545966 31318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:52015
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:13:26.580101 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:26.891834 31812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:26.892108 31812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:26.892251 31812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:26.899135 31812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:26.899245 31812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:26.899396 31812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:26.908535 31812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:26.909647 31812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:26.910935 31812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:26.923331 31824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:26.923532 31818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:26.923312 31819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:26.924067 31812 server_base.cc:1034] running on GCE node
I20260810 03:13:26.924603 31812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:26.925479 31812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:26.926672 31812 hybrid_clock.cc:648] HybridClock initialized: now 1786331606926624 us; error 40 us; skew 500 ppm
I20260810 03:13:26.926962 31812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:26 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331606, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:26.929909 31812 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:13:26.931192 31812 webserver.cc:460] Webserver started at http://127.18.112.67:35225/ using document root <none> and password file <none>
I20260810 03:13:26.931859 31812 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:26.931980 31812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:26.932263 31812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:26.934950 31812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "729a7722ebac456d8d5ddf391f60c064"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "83ee12f7b48c29be024bf05867f2c9d6"
server_key_iv: "208de84465b8e278a17ea51c206402a0"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.935691 31812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "729a7722ebac456d8d5ddf391f60c064"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "83ee12f7b48c29be024bf05867f2c9d6"
server_key_iv: "208de84465b8e278a17ea51c206402a0"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.940462 31812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:13:26.943588 31832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.944804 31812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:26.944947 31812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "729a7722ebac456d8d5ddf391f60c064"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "83ee12f7b48c29be024bf05867f2c9d6"
server_key_iv: "208de84465b8e278a17ea51c206402a0"
server_key_version: "encryptionkey@0"
I20260810 03:13:26.945114 31812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:26.977506 31812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:26.981002 31812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:26.981227 31812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:26.982046 31812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:26.983251 31812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:26.983322 31812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:26.983415 31812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:26.983457 31812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:27.012547 31812 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:42393
I20260810 03:13:27.012609 32012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:42393 every 8 connection(s)
I20260810 03:13:27.013715 31812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:27.017581 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 31812
I20260810 03:13:27.017776 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:27.018385 18881 external_mini_cluster.cc:1428] Setting key a9c438dd9ea603942861da724dd8e3fc
Aug 10 03:13:27 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331606, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:27.032752 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:27.016068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:40503 (local address 127.18.112.126:43623)
0810 03:13:27.016264 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:27.016271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:27.017493 (+ 1222us) server_negotiation.cc:407] Connection header received
0810 03:13:27.019995 (+ 2502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:27.019999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:27.020066 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:27.020169 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:27.021836 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.022579 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.024141 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.024561 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.024659 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:27.027771 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:27.027776 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:27.027779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:27.027836 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:27.030100 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.030695 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.030699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.030701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.030822 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.031148 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.031151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.031153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.031390 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:27.031507 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:27.032281 (+ 774us) server_negotiation.cc:299] Negotiation successful
0810 03:13:27.032492 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:13:27.033779 32015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:27.016611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:40503)
0810 03:13:27.017313 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:27.017369 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:27.019691 (+ 2322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:27.020401 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:27.020412 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:27.021001 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:27.021681 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:27.021700 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.022692 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.022695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:27.024034 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:27.024047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.024726 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.024731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:27.024930 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:27.025566 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:27.025593 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:27.027576 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:27.030223 (+ 2647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:27.030229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:27.030241 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:27.030610 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:27.030900 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:27.030903 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:27.030905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:27.031070 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:27.031478 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:27.031483 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:27.031881 (+ 398us) client_negotiation.cc:769] Sending connection context
0810 03:13:27.032189 (+ 308us) client_negotiation.cc:240] Negotiation successful
0810 03:13:27.032638 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":263,"threads_started":1}
I20260810 03:13:27.034991 32013 heartbeater.cc:347] Connected to a master server at 127.18.112.126:43623
I20260810 03:13:27.035240 32013 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:27.035914 32013 heartbeater.cc:511] Master 127.18.112.126:43623 requested a full tablet report, sending...
I20260810 03:13:27.037294 31318 ts_manager.cc:194] Registered new tserver with Master: 729a7722ebac456d8d5ddf391f60c064 (127.18.112.67:42393)
I20260810 03:13:27.038417 31318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:40503
I20260810 03:13:27.045364 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:13:27.065533 31606 heartbeater.cc:503] Master 127.18.112.126:43623 was elected leader, sending a full tablet report...
WARNING: no policy specified for oryx/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
Entry for principal oryx/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab.
WARNING: no policy specified for oryx/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
Entry for principal oryx/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab.
WARNING: no policy specified for oryx/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
Entry for principal oryx/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab.
I20260810 03:13:27.172382 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 31417
Aug 10 03:13:27 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:13:27.187193 32027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:27.173417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55282 (local address 127.18.112.65:36785)
0810 03:13:27.174057 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:27.174064 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:27.174091 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:13:27.174153 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:27.174159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:27.174387 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:27.174525 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:27.175712 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.176750 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.177851 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.178400 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.178494 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:27.182109 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:27.182122 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:27.182137 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:27.182170 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:27.184917 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.185458 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.185464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.185467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.185613 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.185932 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.185934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.185936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.186306 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:27.186560 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:27.186724 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 03:13:27.186912 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":308,"threads_started":1}
I20260810 03:13:27.188503 31597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:27.270187 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 31417
I20260810 03:13:27.288039 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 31614
Aug 10 03:13:27 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:13:27.303272 32031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:27.288931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46032 (local address 127.18.112.66:42853)
0810 03:13:27.289527 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:27.289534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:27.289559 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:13:27.289616 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:27.289622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:27.289835 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:27.289962 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:27.291084 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.292301 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.293472 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.293984 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.294076 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:27.297922 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:27.297933 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:27.297945 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:27.297978 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:27.300677 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.301298 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.301305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.301307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.301424 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.301759 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.301762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.301764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.302096 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:27.302369 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:27.302682 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 03:13:27.302924 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":323,"threads_started":1}
I20260810 03:13:27.304472 31794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:27.384608 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 31614
I20260810 03:13:27.404031 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 31812
Aug 10 03:13:27 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:13:27.420105 32033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:27.405044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39522 (local address 127.18.112.67:42393)
0810 03:13:27.405645 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:27.405652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:27.405680 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:13:27.405754 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:27.405760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:27.405967 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:27.406115 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:27.407484 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.408563 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.409831 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:27.410385 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:27.410503 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:27.414839 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:27.414850 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:27.414863 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:27.414897 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:27.417501 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.418098 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.418106 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.418108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.418249 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:27.418612 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:27.418616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:27.418618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:27.418954 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:27.419233 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:27.419433 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 03:13:27.419650 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":293,"threads_started":1}
I20260810 03:13:27.421320 32007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:27.501080 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 31812
I20260810 03:13:27.522068 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 31267
I20260810 03:13:27.523237 31365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:27.625191 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 31267
I20260810 03:13:27.649077 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43623
--webserver_interface=127.18.112.126
--webserver_port=34487
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:43623
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:27.965080 32036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:27.965338 32036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:27.965433 32036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:27.972410 32036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:27.972509 32036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:27.972569 32036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:27.972625 32036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:27.972666 32036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:27.982213 32036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:43623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:43623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=34487
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:27.983356 32036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:27.984596 32036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:27.995672 32044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:27.995568 32050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:27.995610 32045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:27.996435 32036 server_base.cc:1034] running on GCE node
I20260810 03:13:27.997126 32036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:27.998325 32036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:27.999522 32036 hybrid_clock.cc:648] HybridClock initialized: now 1786331607999468 us; error 41 us; skew 500 ppm
I20260810 03:13:27.999876 32036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:27 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331607, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:28.002713 32036 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:13:28.004112 32036 webserver.cc:460] Webserver started at http://127.18.112.126:34487/ using document root <none> and password file <none>
I20260810 03:13:28.004696 32036 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:28.004812 32036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:28.009711 32036 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260810 03:13:28.012238 32062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.013455 32036 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 03:13:28.013605 32036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "cdafbf31d87142d8a46366a43bdaa102"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "d94f38e9d569a15ccb6e79229889acea"
server_key_iv: "e9c2c2eceb0e86b91ff470b416a4bfc4"
server_key_version: "encryptionkey@0"
I20260810 03:13:28.014493 32036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:28.053969 32036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:28.057554 32036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:28.057801 32036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:28.074528 32036 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:43623
I20260810 03:13:28.074553 32136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:43623 every 8 connection(s)
I20260810 03:13:28.075924 32036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:28.080286 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 32036
I20260810 03:13:28.081240 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:36785
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:43623
--webserver_port=44099
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:13:28.083202 32137 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:13:28.087280 32137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Bootstrap starting.
I20260810 03:13:28.106150 32137 log.cc:824] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:28.114594 32137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:13:28.115072 32137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Bootstrap complete.
I20260810 03:13:28.124073 32137 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:28.124884 32137 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdafbf31d87142d8a46366a43bdaa102, State: Initialized, Role: FOLLOWER
I20260810 03:13:28.125440 32137 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:28.125653 32137 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:28.125764 32137 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:28.125938 32137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:13:28.129581 32137 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:28.130038 32137 leader_election.cc:302] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdafbf31d87142d8a46366a43bdaa102; no voters:
I20260810 03:13:28.130635 32137 leader_election.cc:288] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:13:28.130774 32145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:13:28.131913 32145 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [term 2 LEADER]: Becoming Leader. State: Replica: cdafbf31d87142d8a46366a43bdaa102, State: Running, Role: LEADER
I20260810 03:13:28.132508 32145 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } }
I20260810 03:13:28.132711 32137 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:28.134918 32149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdafbf31d87142d8a46366a43bdaa102. Latest consensus state: current_term: 2 leader_uuid: "cdafbf31d87142d8a46366a43bdaa102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } } }
I20260810 03:13:28.135289 32149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:28.135824 32146 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cdafbf31d87142d8a46366a43bdaa102" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdafbf31d87142d8a46366a43bdaa102" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 43623 } } }
I20260810 03:13:28.136123 32146 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:28.145157 32157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:28.151185 32157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:28.152715 32157 catalog_manager.cc:1259] Loaded cluster ID: 427936caf4bc4f88830f3e4af97f1736
I20260810 03:13:28.152866 32157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:28.156909 32157 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:28.158452 32157 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cdafbf31d87142d8a46366a43bdaa102: Loaded TSK: 0
I20260810 03:13:28.160059 32157 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:13:28.445111 32142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:28.445386 32142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:28.445533 32142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:28.452435 32142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:28.452533 32142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:28.452661 32142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:28.461761 32142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.65.keytab
--principal=oryx/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:36785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=44099
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:28.462918 32142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:28.464166 32142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:28.478039 32180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:28.478080 32182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:28.478421 32184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:28.479069 32142 server_base.cc:1034] running on GCE node
I20260810 03:13:28.479791 32142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:28.480954 32142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:28.482209 32142 hybrid_clock.cc:648] HybridClock initialized: now 1786331608482140 us; error 50 us; skew 500 ppm
I20260810 03:13:28.482575 32142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331608, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:28.486555 32142 init.cc:377] Logged in from keytab as oryx/127.18.112.65@KRBTEST.COM (short username oryx)
I20260810 03:13:28.488246 32142 webserver.cc:460] Webserver started at http://127.18.112.65:44099/ using document root <none> and password file <none>
I20260810 03:13:28.489125 32142 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:28.489303 32142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:28.496016 32142 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:13:28.499071 32194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.500558 32142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:28.500717 32142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "2ab7ae3ed0cb4834919b2487869376b3"
format_stamp: "Formatted at 2026-08-10 03:13:25 on dist-test-slave-jlzn"
server_key: "7b1cd59d6512d6619549a27ae830a185"
server_key_iv: "eea11a776e9f07c27317366cbe0ff234"
server_key_version: "encryptionkey@0"
I20260810 03:13:28.501916 32142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:28.519923 32142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:28.523761 32142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:28.524019 32142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:28.525005 32142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:28.526376 32142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:28.526470 32142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.526573 32142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:28.526646 32142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.562614 32142 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:36785
I20260810 03:13:28.562676 32373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:36785 every 8 connection(s)
I20260810 03:13:28.564015 32142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:28.566193 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 32142
I20260810 03:13:28.566916 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:42853
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:43623
--webserver_port=34971
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:28.581380 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:28.567019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:46861)
0810 03:13:28.568057 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:28.568093 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:28.569701 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:28.571025 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:28.571036 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:28.571636 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:28.572205 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.572224 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.573765 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.573769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.574976 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.574989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.575977 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.575984 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.576241 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.576866 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:28.576888 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:28.580217 (+ 3329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":576,"threads_started":1}
W20260810 03:13:28.581658 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:28.566819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:46861 (local address 127.18.112.126:43623)
0810 03:13:28.567697 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:28.567713 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:28.568216 (+ 503us) server_negotiation.cc:407] Connection header received
0810 03:13:28.570217 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:28.570230 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:28.570519 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:28.570841 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:28.572407 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.573609 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.575116 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.575737 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.575928 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.580617 (+ 4689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:46861: BlockingRecv error: recv got EOF from 127.18.112.65:46861 (error 108)
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":459,"threads_started":1}
W20260810 03:13:28.581962 32374 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:43623 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.112.126:43623: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:28.590061 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:28.582515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:55767)
0810 03:13:28.582746 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:28.582764 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:28.582856 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:28.583277 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:28.583280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:28.583547 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:28.583683 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.583690 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.585007 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.585010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.585867 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.585878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.586727 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.586730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.586844 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.587350 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:28.587365 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:28.589885 (+ 2520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126}
W20260810 03:13:28.590340 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:28.582800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:55767 (local address 127.18.112.126:43623)
0810 03:13:28.582982 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:28.582988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:28.583019 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:13:28.583072 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:28.583076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:28.583153 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:28.583250 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:28.583827 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.584890 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.586011 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.586603 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.586736 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.590129 (+ 3393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:55767: BlockingRecv error: recv got EOF from 127.18.112.65:55767 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:28.597800 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:28.590659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:39563)
0810 03:13:28.590792 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:28.590807 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:28.590876 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:28.591203 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:28.591207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:28.591455 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:28.591603 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.591611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.592929 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.592932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.593803 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:28.593813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.594655 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.594658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:28.594788 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.595280 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:28.595294 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:28.597609 (+ 2315us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:13:28.598085 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:28.590733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39563 (local address 127.18.112.126:43623)
0810 03:13:28.590878 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:28.590884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:28.590903 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:28.590948 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:28.590952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:28.591053 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:28.591154 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:28.591740 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.592801 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.593916 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:28.594536 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:28.594651 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:28.597829 (+ 3178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:39563: BlockingRecv error: recv got EOF from 127.18.112.65:39563 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 03:13:28.598132 32374 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:13:28.889189 32379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:28.889441 32379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:28.889577 32379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:28.896543 32379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:28.896644 32379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:28.896797 32379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:28.905897 32379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.66.keytab
--principal=oryx/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:42853
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=34971
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:28.907094 32379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:28.908352 32379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:28.920378 32387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:28.920444 32389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:28.920421 32392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:28.921514 32379 server_base.cc:1034] running on GCE node
I20260810 03:13:28.922061 32379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:28.922890 32379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:28.924077 32379 hybrid_clock.cc:648] HybridClock initialized: now 1786331608924028 us; error 39 us; skew 500 ppm
I20260810 03:13:28.924350 32379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:28 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331608, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:28.927245 32379 init.cc:377] Logged in from keytab as oryx/127.18.112.66@KRBTEST.COM (short username oryx)
I20260810 03:13:28.928606 32379 webserver.cc:460] Webserver started at http://127.18.112.66:34971/ using document root <none> and password file <none>
I20260810 03:13:28.929225 32379 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:28.929351 32379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:28.934340 32379 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:13:28.936808 32402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.938001 32379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:28.938148 32379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "07f75b6f079f423aa159757a4c1cddb5"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "6b1918aa70cc7592834324718f9f38c9"
server_key_iv: "b5d5d313b58403724c15fd8ec543b937"
server_key_version: "encryptionkey@0"
I20260810 03:13:28.939038 32379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:28.964226 32379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:28.968163 32379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:28.968426 32379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:28.969457 32379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:28.970683 32379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:28.970782 32379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:28.970885 32379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:28.970963 32379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:29.000504 32379 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:42853
I20260810 03:13:29.000561 32570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:42853 every 8 connection(s)
I20260810 03:13:29.001821 32379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:29.006027 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 32379
I20260810 03:13:29.006750 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:42393
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:43623
--webserver_port=35225
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:13:29.018535 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.004177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:35685 (local address 127.18.112.126:43623)
0810 03:13:29.004346 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.004351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.005492 (+ 1141us) server_negotiation.cc:407] Connection header received
0810 03:13:29.007889 (+ 2397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.007893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.007959 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.008057 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.009840 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.010544 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.012534 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.012939 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.013041 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.018258 (+ 5217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:35685: BlockingRecv error: recv got EOF from 127.18.112.66:35685 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:13:29.018961 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.004636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:35685)
0810 03:13:29.005331 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.005378 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.007596 (+ 2218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.008303 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.008315 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.008971 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.009692 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.009715 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.010702 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.010707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.012410 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.012424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.013152 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.013160 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.013414 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.014098 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.014124 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.018020 (+ 3896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":260,"threads_started":1}
W20260810 03:13:29.019555 32571 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:43623 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.112.126:43623: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:29.027945 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.020106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:49263)
0810 03:13:29.020287 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.020305 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.020394 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.020655 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.020660 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.021009 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.021172 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.021182 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.022090 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.022094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.023388 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.023401 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.024096 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.024102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.024274 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.024798 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.024818 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.027662 (+ 2844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260810 03:13:29.028085 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.020230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:49263 (local address 127.18.112.126:43623)
0810 03:13:29.020372 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.020375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.020391 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:13:29.020486 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.020489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.020541 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.020613 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.021277 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.021956 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.023510 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.023944 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.024045 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.027884 (+ 3839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:49263: BlockingRecv error: recv got EOF from 127.18.112.66:49263 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:29.035521 32573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.028677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:46117)
0810 03:13:29.028829 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.028847 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.028959 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.029251 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.029256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.029517 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.029651 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.029659 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.030566 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.030569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.031449 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.031459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.032152 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.032159 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.032309 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.032856 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.032872 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.035258 (+ 2386us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 03:13:29.035656 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.028759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:46117 (local address 127.18.112.126:43623)
0810 03:13:29.028912 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.028917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.028934 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:13:29.029065 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.029070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.029126 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.029202 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.029776 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.030443 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.031586 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.032016 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.032120 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.035455 (+ 3335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:46117: BlockingRecv error: recv got EOF from 127.18.112.66:46117 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 03:13:29.035894 32571 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:13:29.326450 32574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:29.326689 32574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:29.326784 32574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:29.333650 32574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:29.333741 32574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:29.333849 32574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:29.342859 32574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/krb5kdc/oryx_127.18.112.67.keytab
--principal=oryx/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:42393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=35225
--tserver_master_addrs=127.18.112.126:43623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:29.343994 32574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:29.345125 32574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:29.357105 32581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:29.357158 32582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:29.357302 32590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:29.357899 32574 server_base.cc:1034] running on GCE node
I20260810 03:13:29.358448 32574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:29.359261 32574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:29.360446 32574 hybrid_clock.cc:648] HybridClock initialized: now 1786331609360402 us; error 33 us; skew 500 ppm
I20260810 03:13:29.360721 32574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331609, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:29.363564 32574 init.cc:377] Logged in from keytab as oryx/127.18.112.67@KRBTEST.COM (short username oryx)
I20260810 03:13:29.364940 32574 webserver.cc:460] Webserver started at http://127.18.112.67:35225/ using document root <none> and password file <none>
I20260810 03:13:29.365549 32574 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:29.365680 32574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:29.370558 32574 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260810 03:13:29.373034 32598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:29.374197 32574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:13:29.374339 32574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "729a7722ebac456d8d5ddf391f60c064"
format_stamp: "Formatted at 2026-08-10 03:13:26 on dist-test-slave-jlzn"
server_key: "83ee12f7b48c29be024bf05867f2c9d6"
server_key_iv: "208de84465b8e278a17ea51c206402a0"
server_key_version: "encryptionkey@0"
I20260810 03:13:29.375207 32574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:29.386268 32574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:29.389608 32574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:29.389843 32574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:29.390687 32574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:29.391877 32574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:29.391980 32574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:29.392082 32574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:29.392160 32574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:29.420691 32574 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:42393
I20260810 03:13:29.420756 32765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:42393 every 8 connection(s)
I20260810 03:13:29.421958 32574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:29.422611 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 32574
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:13:29.437361 305 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.424565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:38713 (local address 127.18.112.126:43623)
0810 03:13:29.425002 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.425006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.425871 (+ 865us) server_negotiation.cc:407] Connection header received
0810 03:13:29.427569 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.427575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.427653 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.427740 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.429154 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.429945 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.431386 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.431856 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.431983 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.437071 (+ 5088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:38713: BlockingRecv error: recv got EOF from 127.18.112.67:38713 (error 108)
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":504,"threads_started":1}
I20260810 03:13:29.437732 309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.425003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:38713)
0810 03:13:29.425741 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.425775 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.427334 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.428002 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.428009 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.428480 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.428981 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.428997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.430091 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.430094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.431255 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.431267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.432081 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.432090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.432382 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.433086 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.433114 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.436804 (+ 3690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":306,"threads_started":1}
W20260810 03:13:29.438344 300 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:43623 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.112.126:43623: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
I20260810 03:13:29.438916 32376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.423612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37336 (local address 127.18.112.126:43623)
0810 03:13:29.423776 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.423781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.424360 (+ 579us) server_negotiation.cc:407] Connection header received
0810 03:13:29.424781 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.424786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.424875 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.424980 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.426839 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.427552 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.428810 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.429248 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.429381 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.431859 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:29.431871 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:29.431889 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:29.431936 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:29.435389 (+ 3453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:29.436094 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:29.436104 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:29.436109 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:29.436351 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:29.436720 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:29.436725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:29.436729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:29.437324 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:29.437654 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:29.438257 (+ 603us) server_negotiation.cc:299] Negotiation successful
0810 03:13:29.438565 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:29.446452 309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.438899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:57333)
0810 03:13:29.439060 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.439075 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.439166 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.439470 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.439475 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.439880 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.440042 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.440052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.441355 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.441360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.442379 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.442394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.443187 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.443194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.443322 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.443770 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.443786 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.446273 (+ 2487us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:13:29.446632 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.438968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:57333 (local address 127.18.112.126:43623)
0810 03:13:29.439218 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.439224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.439240 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:13:29.439298 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.439301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.439351 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.439419 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.440175 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.441206 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.442510 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.443015 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.443107 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.446433 (+ 3326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:57333: BlockingRecv error: recv got EOF from 127.18.112.67:57333 (error 108)
Metrics: {"server-negotiator.queue_time_us":163}
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:29.453307 309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.446964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:55857)
0810 03:13:29.447104 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.447122 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.447215 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.447464 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.447467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.447736 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.447899 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.447908 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.448728 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.448731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.449611 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.449621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.450202 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.450206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.450315 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.450716 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.450731 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.453043 (+ 2312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 03:13:29.453446 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.447074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:55857 (local address 127.18.112.126:43623)
0810 03:13:29.447278 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.447282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.447295 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:13:29.447328 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.447331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.447374 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.447441 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.448013 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.448617 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.449708 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.450101 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.450191 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.453213 (+ 3022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:55857: BlockingRecv error: recv got EOF from 127.18.112.67:55857 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
W20260810 03:13:29.453696 300 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:29 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:29.606518 310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:29.598666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:35579)
0810 03:13:29.599134 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:29.599151 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:29.599258 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:29.599514 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:29.599517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:29.600000 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:29.600205 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.600215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.601095 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.601098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.602041 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:29.602053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.602868 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.602874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:29.603025 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.603592 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:29.603614 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:29.606280 (+ 2666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":249,"threads_started":1}
W20260810 03:13:29.606769 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:29.598715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:35579 (local address 127.18.112.126:43623)
0810 03:13:29.598908 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:29.598915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:29.599222 (+ 307us) server_negotiation.cc:407] Connection header received
0810 03:13:29.599346 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:29.599350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:29.599412 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:29.599487 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:29.600317 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.600990 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.602140 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:29.602688 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:29.602808 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:29.606489 (+ 3681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:35579: BlockingRecv error: recv got EOF from 127.18.112.65:35579 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:30.044834 311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:30.036391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:52445)
0810 03:13:30.036859 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:30.036875 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:30.036984 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:30.037261 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:30.037265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:30.037702 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:30.037893 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.037903 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.038907 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.038912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.040241 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.040254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.040914 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.040918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.041032 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.041606 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:30.041624 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:30.044503 (+ 2879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":242,"threads_started":1}
W20260810 03:13:30.044962 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:30.036464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52445 (local address 127.18.112.126:43623)
0810 03:13:30.036644 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:30.036649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:30.036936 (+ 287us) server_negotiation.cc:407] Connection header received
0810 03:13:30.037076 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:30.037080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:30.037158 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:30.037232 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:30.037997 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.038768 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.040365 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.040779 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.040864 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.044729 (+ 3865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:52445: BlockingRecv error: recv got EOF from 127.18.112.66:52445 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:30.462052 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:30.454270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:49183)
0810 03:13:30.454720 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:30.454738 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:30.454845 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:30.455102 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:30.455105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:30.455547 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:30.455748 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.455758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.456849 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.456853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.457827 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.457838 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.458501 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.458506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.458623 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.459143 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:30.459159 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:30.461818 (+ 2659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":230,"threads_started":1}
W20260810 03:13:30.462188 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:30.454298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:49183 (local address 127.18.112.126:43623)
0810 03:13:30.454486 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:30.454492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:30.454809 (+ 317us) server_negotiation.cc:407] Connection header received
0810 03:13:30.454932 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:30.454935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:30.454996 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:30.455076 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:30.455923 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.456721 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.457935 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.458370 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.458459 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.461990 (+ 3531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:49183: BlockingRecv error: recv got EOF from 127.18.112.67:49183 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:30 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:30.615136 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:30.607336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:53057)
0810 03:13:30.607793 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:30.607833 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:30.607951 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:30.608274 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:30.608278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:30.608681 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:30.608855 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.608864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.609799 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.609804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.610690 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:30.610701 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.611299 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.611304 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:30.611419 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.612030 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:30.612052 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:30.614900 (+ 2848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":239,"threads_started":1}
W20260810 03:13:30.615298 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:30.607386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:53057 (local address 127.18.112.126:43623)
0810 03:13:30.607579 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:30.607586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:30.607908 (+ 322us) server_negotiation.cc:407] Connection header received
0810 03:13:30.608077 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:30.608081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:30.608146 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:30.608214 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:30.608963 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.609685 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.610788 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:30.611176 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:30.611261 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:30.615088 (+ 3827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:53057: BlockingRecv error: recv got EOF from 127.18.112.65:53057 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:31.053896 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:31.045612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:41711)
0810 03:13:31.046109 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:31.046125 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:31.046259 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:31.046581 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:31.046618 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:31.047034 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:31.047234 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.047245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.048295 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.048299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.049210 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.049223 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.050011 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.050018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.050200 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.050836 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:31.050862 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:31.053665 (+ 2803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":253,"threads_started":1}
W20260810 03:13:31.054057 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:31.045817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:41711 (local address 127.18.112.126:43623)
0810 03:13:31.046028 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:31.046034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:31.046194 (+ 160us) server_negotiation.cc:407] Connection header received
0810 03:13:31.046370 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:31.046376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:31.046452 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:31.046530 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:31.047370 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.048148 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.049350 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.049858 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.049986 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.053858 (+ 3872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:41711: BlockingRecv error: recv got EOF from 127.18.112.66:41711 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:31.474025 316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:31.462880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:37575)
0810 03:13:31.463376 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:31.463393 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:31.463501 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:31.463794 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:31.463797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:31.464208 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:31.464376 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.464384 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.465277 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.465280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.466166 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.466177 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.466774 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.466778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.466881 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.470839 (+ 3958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:31.470856 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:31.473779 (+ 2923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":278,"threads_started":1}
W20260810 03:13:31.474184 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:31.463005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:37575 (local address 127.18.112.126:43623)
0810 03:13:31.463179 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:31.463183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:31.463456 (+ 273us) server_negotiation.cc:407] Connection header received
0810 03:13:31.463587 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:31.463591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:31.463688 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:31.463767 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:31.464481 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.465167 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.466266 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.466664 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.466753 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.473950 (+ 7197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:37575: BlockingRecv error: recv got EOF from 127.18.112.67:37575 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:31 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:31.624241 317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:31.616015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:37759)
0810 03:13:31.616584 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:31.616600 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:31.616712 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:31.616962 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:31.616964 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:31.617366 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:31.617548 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.617560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.618691 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.618695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.619610 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:31.619622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.620304 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.620308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:31.620424 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.620991 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:31.621008 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:31.623955 (+ 2947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":302,"threads_started":1}
W20260810 03:13:31.624328 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:31.616123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:37759 (local address 127.18.112.126:43623)
0810 03:13:31.616284 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:31.616289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:31.616662 (+ 373us) server_negotiation.cc:407] Connection header received
0810 03:13:31.616794 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:31.616797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:31.616856 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:31.616931 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:31.617685 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.618558 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.619715 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:31.620203 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:31.620294 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:31.624139 (+ 3845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:37759: BlockingRecv error: recv got EOF from 127.18.112.65:37759 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:32.062660 319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:32.054747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:56993)
0810 03:13:32.055252 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:32.055268 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:32.055399 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:32.055704 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:32.055709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:32.056089 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:32.056287 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.056297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.057573 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.057579 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.058550 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.058563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.059173 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.059177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.059293 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.059854 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:32.059877 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:32.062413 (+ 2536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":246,"threads_started":1}
W20260810 03:13:32.062817 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:32.054820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:56993 (local address 127.18.112.126:43623)
0810 03:13:32.055030 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:32.055036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:32.055351 (+ 315us) server_negotiation.cc:407] Connection header received
0810 03:13:32.055510 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:32.055516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:32.055577 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:32.055663 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:32.056431 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.057423 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.058674 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.059059 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.059158 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.062593 (+ 3435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:56993: BlockingRecv error: recv got EOF from 127.18.112.66:56993 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:32.482726 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:32.474847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:41677)
0810 03:13:32.475627 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:32.475665 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:32.475831 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:32.476160 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:32.476163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:32.476499 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:32.476673 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.476682 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.477581 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.477584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.478506 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.478517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.479222 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.479227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.479350 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.479940 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:32.479957 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:32.482453 (+ 2496us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":519,"threads_started":1}
W20260810 03:13:32.482808 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:32.474927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41677 (local address 127.18.112.126:43623)
0810 03:13:32.475141 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:32.475148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:32.475743 (+ 595us) server_negotiation.cc:407] Connection header received
0810 03:13:32.475972 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:32.475978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:32.476044 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:32.476120 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:32.476784 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.477478 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.478662 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.479103 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.479204 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.482629 (+ 3425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:41677: BlockingRecv error: recv got EOF from 127.18.112.67:41677 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:32 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:32.632989 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:32.625102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:48399)
0810 03:13:32.625646 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:32.625662 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:32.625789 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:32.626111 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:32.626115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:32.626498 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:32.626649 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.626658 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.627666 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.627672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.628664 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:32.628676 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.629322 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.629328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:32.629491 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.630052 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:32.630070 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:32.632637 (+ 2567us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":338,"threads_started":1}
W20260810 03:13:32.633121 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:32.625125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:48399 (local address 127.18.112.126:43623)
0810 03:13:32.625305 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:32.625312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:32.625749 (+ 437us) server_negotiation.cc:407] Connection header received
0810 03:13:32.625900 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:32.625905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:32.625969 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:32.626051 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:32.626793 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.627539 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.628806 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:32.629189 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:32.629295 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:32.632861 (+ 3566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:48399: BlockingRecv error: recv got EOF from 127.18.112.65:48399 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:33.071115 322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:33.063505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:47627)
0810 03:13:33.063964 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:33.063980 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:33.064091 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:33.064374 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:33.064378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:33.064750 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:33.064899 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.064908 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.065846 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.065849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.066921 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.066935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.067523 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.067527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.067644 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.068279 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:33.068297 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:33.070890 (+ 2593us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":229,"threads_started":1}
W20260810 03:13:33.071287 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:33.063573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:47627 (local address 127.18.112.126:43623)
0810 03:13:33.063780 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:33.063785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:33.064052 (+ 267us) server_negotiation.cc:407] Connection header received
0810 03:13:33.064191 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:33.064194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:33.064269 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:33.064346 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:33.065007 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.065746 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.067030 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.067418 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.067504 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.071067 (+ 3563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:47627: BlockingRecv error: recv got EOF from 127.18.112.66:47627 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:33.491726 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:33.483585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:43743)
0810 03:13:33.484069 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:33.484086 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:33.484225 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:33.484524 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:33.484528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:33.484917 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:33.485067 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.485076 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.486079 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.486083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.487263 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.487278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.488058 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.488064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.488239 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.488815 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:33.488833 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:33.491466 (+ 2633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":281,"threads_started":1}
W20260810 03:13:33.491942 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:33.483652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:43743 (local address 127.18.112.126:43623)
0810 03:13:33.483850 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:33.483856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:33.484166 (+ 310us) server_negotiation.cc:407] Connection header received
0810 03:13:33.484334 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:33.484338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:33.484398 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:33.484477 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:33.485213 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.485951 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.487432 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.487917 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.488031 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.491682 (+ 3651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:43743: BlockingRecv error: recv got EOF from 127.18.112.67:43743 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:33 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:33.641646 325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:33.633884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:37421)
0810 03:13:33.634502 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:33.634518 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:33.634639 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:33.634908 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:33.634911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:33.635345 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:33.635503 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.635512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.636493 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.636496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.637447 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:33.637460 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.638066 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.638070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:33.638185 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.638713 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:33.638736 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:33.641383 (+ 2647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":327,"threads_started":1}
W20260810 03:13:33.641767 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:33.634057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:37421 (local address 127.18.112.126:43623)
0810 03:13:33.634235 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:33.634240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:33.634616 (+ 376us) server_negotiation.cc:407] Connection header received
0810 03:13:33.634730 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:33.634734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:33.634797 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:33.634878 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:33.635671 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.636387 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.637552 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:33.637963 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:33.638052 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:33.641563 (+ 3511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:37421: BlockingRecv error: recv got EOF from 127.18.112.65:37421 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:34.080361 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:34.071958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:36361)
0810 03:13:34.072443 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:34.072459 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:34.072571 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:34.072852 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:34.072856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:34.073235 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:34.073400 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.073409 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.074364 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.074367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.075275 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.075287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.076216 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.076220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.076337 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.076917 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:34.076936 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:34.080003 (+ 3067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":236,"threads_started":1}
W20260810 03:13:34.080463 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:34.072106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:36361 (local address 127.18.112.126:43623)
0810 03:13:34.072322 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:34.072327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:34.072527 (+ 200us) server_negotiation.cc:407] Connection header received
0810 03:13:34.072666 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:34.072670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:34.072745 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:34.072824 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:34.073503 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.074236 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.075413 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.076097 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.076211 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.080208 (+ 3997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:36361: BlockingRecv error: recv got EOF from 127.18.112.66:36361 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:34.500101 328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:34.492578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:48715)
0810 03:13:34.493089 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:34.493106 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:34.493249 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:34.493533 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:34.493536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:34.493926 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:34.494088 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.494097 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.495023 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.495026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.495984 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.495997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.496651 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.496655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.496766 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.497284 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:34.497301 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:34.499844 (+ 2543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":239,"threads_started":1}
W20260810 03:13:34.500264 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:34.492662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:48715 (local address 127.18.112.126:43623)
0810 03:13:34.492846 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:34.492852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:34.493194 (+ 342us) server_negotiation.cc:407] Connection header received
0810 03:13:34.493361 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:34.493365 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:34.493427 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:34.493513 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:34.494202 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.494915 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.496095 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.496537 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.496637 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.500022 (+ 3385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:48715: BlockingRecv error: recv got EOF from 127.18.112.67:48715 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:34 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:34.650359 329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:34.642480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:37737)
0810 03:13:34.643012 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:34.643029 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:34.643154 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:34.643410 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:34.643413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:34.643858 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:34.644024 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.644034 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.645093 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.645098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.646129 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:34.646144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.646808 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.646812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:34.646929 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.647463 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:34.647481 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:34.650128 (+ 2647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":288,"threads_started":1}
W20260810 03:13:34.650566 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:34.642562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:37737 (local address 127.18.112.126:43623)
0810 03:13:34.642755 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:34.642761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:34.643097 (+ 336us) server_negotiation.cc:407] Connection header received
0810 03:13:34.643240 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:34.643243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:34.643306 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:34.643383 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:34.644160 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.644956 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.646259 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:34.646691 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:34.646782 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:34.650330 (+ 3548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:37737: BlockingRecv error: recv got EOF from 127.18.112.65:37737 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:35.089270 330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:35.081309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:47209)
0810 03:13:35.081809 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:35.081825 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:35.081958 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:35.082310 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:35.082314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:35.082728 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:35.082877 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.082887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.083883 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.083888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.084785 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.084796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.085490 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.085496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.085666 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.086185 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:35.086202 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:35.088974 (+ 2772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":262,"threads_started":1}
W20260810 03:13:35.089444 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:35.081364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:47209 (local address 127.18.112.126:43623)
0810 03:13:35.081533 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:35.081540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:35.081916 (+ 376us) server_negotiation.cc:407] Connection header received
0810 03:13:35.082082 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:35.082087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:35.082177 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:35.082259 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:35.083021 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.083719 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.084926 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.085338 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.085446 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.089172 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:47209: BlockingRecv error: recv got EOF from 127.18.112.66:47209 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:35.509104 331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:35.500937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:55899)
0810 03:13:35.501432 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:35.501451 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:35.501596 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:35.501918 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:35.501922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:35.502468 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:35.502636 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.502648 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.503650 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.503655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.504570 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.504582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.505308 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.505314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.505474 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.506061 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:35.506080 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:35.508805 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":248,"threads_started":1}
W20260810 03:13:35.509245 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:35.501026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:55899 (local address 127.18.112.126:43623)
0810 03:13:35.501250 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:35.501257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:35.501535 (+ 278us) server_negotiation.cc:407] Connection header received
0810 03:13:35.501711 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:35.501717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:35.501785 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:35.501867 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:35.502783 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.503514 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.504712 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.505152 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.505270 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.509024 (+ 3754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:55899: BlockingRecv error: recv got EOF from 127.18.112.67:55899 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:35 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:35.659204 332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:35.651241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:60029)
0810 03:13:35.651854 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:35.651872 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:35.652002 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:35.652379 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:35.652383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:35.652804 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:35.652972 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.652981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.653975 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.653980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.654904 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:35.654916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.655611 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.655617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:35.655782 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.656320 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:35.656336 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:35.658867 (+ 2531us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":258,"threads_started":1}
W20260810 03:13:35.659425 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:35.651295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:60029 (local address 127.18.112.126:43623)
0810 03:13:35.651470 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:35.651477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:35.651947 (+ 470us) server_negotiation.cc:407] Connection header received
0810 03:13:35.652124 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:35.652138 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:35.652226 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:35.652304 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:35.653119 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.653835 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.655036 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:35.655466 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:35.655583 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:35.659080 (+ 3497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:60029: BlockingRecv error: recv got EOF from 127.18.112.65:60029 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:36.098264 333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:36.090174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:56205)
0810 03:13:36.090729 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:36.090746 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:36.090869 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:36.091199 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:36.091205 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:36.091642 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:36.091831 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.091841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.092867 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.092871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.093813 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.093826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.094502 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.094508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.094670 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.095180 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:36.095197 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:36.097921 (+ 2724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":237,"threads_started":1}
W20260810 03:13:36.098413 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:36.090236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:56205 (local address 127.18.112.126:43623)
0810 03:13:36.090493 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:36.090500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:36.090823 (+ 323us) server_negotiation.cc:407] Connection header received
0810 03:13:36.090977 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:36.090981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:36.091056 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:36.091145 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:36.091974 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.092729 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.093948 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.094359 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.094474 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.098139 (+ 3665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:56205: BlockingRecv error: recv got EOF from 127.18.112.66:56205 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:36.524266 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:36.510079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:52151)
0810 03:13:36.510679 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:36.510695 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:36.510821 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:36.511162 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:36.511167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:36.511619 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:36.511832 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.511846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.512848 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.512853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.513781 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.513793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.514498 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.514503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.514671 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.521065 (+ 6394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:36.521089 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:36.524027 (+ 2938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":230,"threads_started":1}
W20260810 03:13:36.524456 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:36.510126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:52151 (local address 127.18.112.126:43623)
0810 03:13:36.510284 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:36.510290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:36.510775 (+ 485us) server_negotiation.cc:407] Connection header received
0810 03:13:36.510934 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:36.510940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:36.511019 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:36.511100 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:36.511978 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.512712 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.513921 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.514353 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.514462 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.524227 (+ 9765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:52151: BlockingRecv error: recv got EOF from 127.18.112.67:52151 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:36 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:36.667681 336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:36.660106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:40327)
0810 03:13:36.660606 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:36.660622 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:36.660736 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:36.660990 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:36.660993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:36.661394 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:36.661545 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.661554 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.662498 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.662501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.663401 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:36.663413 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.664139 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.664146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:36.664299 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.664840 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:36.664856 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:36.667444 (+ 2588us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":251,"threads_started":1}
W20260810 03:13:36.667852 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:36.660237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:40327 (local address 127.18.112.126:43623)
0810 03:13:36.660394 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:36.660399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:36.660686 (+ 287us) server_negotiation.cc:407] Connection header received
0810 03:13:36.660820 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:36.660824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:36.660884 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:36.660972 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:36.661650 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.662381 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.663502 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:36.663963 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:36.664089 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:36.667622 (+ 3533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:40327: BlockingRecv error: recv got EOF from 127.18.112.65:40327 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:37.107169 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:37.099052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:41721)
0810 03:13:37.099565 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:37.099581 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:37.099712 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:37.100089 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:37.100094 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:37.100503 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:37.100665 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.100674 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.101805 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.101809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.102740 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.102753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.103506 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.103512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.103669 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.104220 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:37.104237 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:37.106951 (+ 2714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":261,"threads_started":1}
W20260810 03:13:37.107430 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:37.099139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:41721 (local address 127.18.112.126:43623)
0810 03:13:37.099325 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:37.099331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:37.099665 (+ 334us) server_negotiation.cc:407] Connection header received
0810 03:13:37.099844 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:37.099851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:37.099934 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:37.100018 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:37.100810 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.101662 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.102894 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.103329 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.103440 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.107151 (+ 3711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:41721: BlockingRecv error: recv got EOF from 127.18.112.66:41721 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:37.533318 338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:37.525118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:40177)
0810 03:13:37.525657 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:37.525673 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:37.525789 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:37.526044 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:37.526047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:37.526455 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:37.526604 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.526612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.527624 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.527636 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.528587 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.528600 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.529250 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.529255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.529362 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.529920 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:37.529942 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:37.533012 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
W20260810 03:13:37.533519 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:37.525209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:40177 (local address 127.18.112.126:43623)
0810 03:13:37.525382 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:37.525386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:37.525739 (+ 353us) server_negotiation.cc:407] Connection header received
0810 03:13:37.525876 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:37.525879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:37.525940 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:37.526016 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:37.526716 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.527474 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.528700 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.529109 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.529206 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.533268 (+ 4062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:40177: BlockingRecv error: recv got EOF from 127.18.112.67:40177 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:37 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:37.676674 339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:37.668628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:49323)
0810 03:13:37.669150 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:37.669166 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:37.669277 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:37.669622 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:37.669627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:37.670027 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:37.670208 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.670218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.671226 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.671230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.672221 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:37.672234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.672913 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.672920 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:37.673082 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.673598 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:37.673614 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:37.676342 (+ 2728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":272,"threads_started":1}
W20260810 03:13:37.676785 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:37.668662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:49323 (local address 127.18.112.126:43623)
0810 03:13:37.668845 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:37.668851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:37.669236 (+ 385us) server_negotiation.cc:407] Connection header received
0810 03:13:37.669403 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:37.669407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:37.669468 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:37.669554 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:37.670349 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.671089 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.672360 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:37.672769 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:37.672874 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:37.676539 (+ 3665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:49323: BlockingRecv error: recv got EOF from 127.18.112.65:49323 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:38.115494 340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:38.108013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:47343)
0810 03:13:38.108463 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:38.108479 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:38.108592 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:38.108854 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:38.108857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:38.109248 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:38.109414 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.109423 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.110348 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.110352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.111294 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.111306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.111963 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.111968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.112088 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.112603 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:38.112619 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:38.115253 (+ 2634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":232,"threads_started":1}
W20260810 03:13:38.115640 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:38.108040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:47343 (local address 127.18.112.126:43623)
0810 03:13:38.108249 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:38.108257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:38.108576 (+ 319us) server_negotiation.cc:407] Connection header received
0810 03:13:38.108682 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:38.108686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:38.108749 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:38.108825 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:38.109518 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.110250 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.111395 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.111852 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.111938 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.115430 (+ 3492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:47343: BlockingRecv error: recv got EOF from 127.18.112.66:47343 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:38.542459 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:38.534177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:48995)
0810 03:13:38.534666 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:38.534682 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:38.534805 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:38.535131 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:38.535137 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:38.535555 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:38.535729 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.535738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.536770 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.536774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.537705 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.537717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.538378 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.538385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.538543 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.539050 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:38.539068 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:38.542219 (+ 3151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":262,"threads_started":1}
W20260810 03:13:38.542615 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:38.534227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:48995 (local address 127.18.112.126:43623)
0810 03:13:38.534402 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:38.534409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:38.534759 (+ 350us) server_negotiation.cc:407] Connection header received
0810 03:13:38.534920 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:38.534924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:38.535000 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:38.535079 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:38.535897 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.536636 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.537836 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.538235 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.538342 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.542421 (+ 4079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:48995: BlockingRecv error: recv got EOF from 127.18.112.67:48995 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:38 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:38.685560 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:38.677664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:41173)
0810 03:13:38.678558 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:38.678574 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:38.678683 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:38.678965 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:38.678968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:38.679377 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:38.679536 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.679546 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.680588 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.680591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.681516 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:38.681527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.682115 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.682119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:38.682245 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.682748 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:38.682764 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:38.685339 (+ 2575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":775,"thread_start_us":661,"threads_started":1}
W20260810 03:13:38.685766 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:38.677828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:41173 (local address 127.18.112.126:43623)
0810 03:13:38.677995 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:38.678001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:38.678641 (+ 640us) server_negotiation.cc:407] Connection header received
0810 03:13:38.678798 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:38.678804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:38.678871 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:38.678948 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:38.679661 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.680493 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.681618 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:38.682008 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:38.682095 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:38.685511 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:41173: BlockingRecv error: recv got EOF from 127.18.112.65:41173 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:39.123706 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:39.116340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:58761)
0810 03:13:39.116778 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:39.116793 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:39.116900 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:39.117176 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:39.117180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:39.117614 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:39.117773 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.117782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.118766 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.118770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.119687 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.119698 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.120349 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.120353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.120465 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.120966 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:39.120983 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:39.123483 (+ 2500us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":232,"threads_started":1}
W20260810 03:13:39.123879 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:39.116403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:58761 (local address 127.18.112.126:43623)
0810 03:13:39.116594 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:39.116600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:39.116861 (+ 261us) server_negotiation.cc:407] Connection header received
0810 03:13:39.116983 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:39.116987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:39.117064 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:39.117156 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:39.117889 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.118652 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.119787 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.120236 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.120327 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.123657 (+ 3330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:58761: BlockingRecv error: recv got EOF from 127.18.112.66:58761 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:39.551047 345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:39.543293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:56711)
0810 03:13:39.543786 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:39.543826 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:39.543943 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:39.544193 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:39.544196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:39.544603 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:39.544765 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.544773 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.545838 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.545842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.546775 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.546786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.547385 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.547389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.547497 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.548040 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:39.548057 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:39.550809 (+ 2752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":266,"threads_started":1}
W20260810 03:13:39.551208 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:39.543406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:56711 (local address 127.18.112.126:43623)
0810 03:13:39.543563 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:39.543567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:39.543890 (+ 323us) server_negotiation.cc:407] Connection header received
0810 03:13:39.544021 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:39.544025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:39.544086 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:39.544162 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:39.544892 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.545698 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.546882 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.547277 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.547362 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.551000 (+ 3638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:56711: BlockingRecv error: recv got EOF from 127.18.112.67:56711 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:39 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:39.694309 346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:39.686421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:39995)
0810 03:13:39.687062 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:39.687082 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:39.687215 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:39.687528 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:39.687531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:39.688100 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:39.688290 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.688300 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.689260 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.689263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.690131 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:39.690143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.690799 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.690804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:39.690933 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.691452 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:39.691469 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:39.694075 (+ 2606us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":399,"threads_started":1}
W20260810 03:13:39.694460 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:39.686476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39995 (local address 127.18.112.126:43623)
0810 03:13:39.686675 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:39.686681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:39.687164 (+ 483us) server_negotiation.cc:407] Connection header received
0810 03:13:39.687328 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:39.687331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:39.687394 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:39.687490 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:39.688413 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.689156 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.690232 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:39.690673 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:39.690759 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:39.694254 (+ 3495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:39995: BlockingRecv error: recv got EOF from 127.18.112.65:39995 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:40.132346 348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:40.124624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:32859)
0810 03:13:40.125126 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:40.125150 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:40.125272 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:40.125624 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:40.125628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:40.126037 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:40.126227 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.126237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.127116 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.127119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.128048 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.128059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.128667 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.128671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.128790 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.129314 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:40.129331 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:40.132079 (+ 2748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":256,"threads_started":1}
W20260810 03:13:40.132455 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:40.124688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:32859 (local address 127.18.112.126:43623)
0810 03:13:40.124841 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:40.124847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:40.125228 (+ 381us) server_negotiation.cc:407] Connection header received
0810 03:13:40.125375 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:40.125378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:40.125480 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:40.125576 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:40.126338 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.127011 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.128155 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.128559 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.128658 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.132257 (+ 3599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:32859: BlockingRecv error: recv got EOF from 127.18.112.66:32859 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:40.559495 352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:40.551951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:60195)
0810 03:13:40.552459 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:40.552475 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:40.552585 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:40.552851 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:40.552854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:40.553272 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:40.553445 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.553454 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.554356 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.554359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.555238 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.555249 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.555842 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.555846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.555966 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.556550 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:40.556569 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:40.559238 (+ 2669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":266,"threads_started":1}
W20260810 03:13:40.559634 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:40.552003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:60195 (local address 127.18.112.126:43623)
0810 03:13:40.552162 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:40.552166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:40.552537 (+ 371us) server_negotiation.cc:407] Connection header received
0810 03:13:40.552688 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:40.552691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:40.552751 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:40.552821 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:40.553567 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.554262 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.555337 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.555720 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.555834 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.559430 (+ 3596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:60195: BlockingRecv error: recv got EOF from 127.18.112.67:60195 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:40 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:40.703282 357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:40.695152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:42823)
0810 03:13:40.695665 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:40.695682 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:40.695868 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:40.696231 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:40.696235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:40.696627 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:40.696794 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.696803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.697789 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.697793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.698886 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:40.698900 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.699629 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.699634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:40.699766 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.700300 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:40.700317 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:40.702956 (+ 2639us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":277,"threads_started":1}
W20260810 03:13:40.703395 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:40.695210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:42823 (local address 127.18.112.126:43623)
0810 03:13:40.695360 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:40.695364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:40.695746 (+ 382us) server_negotiation.cc:407] Connection header received
0810 03:13:40.695999 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:40.696004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:40.696080 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:40.696186 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:40.696901 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.697673 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.699021 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:40.699502 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:40.699594 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:40.703181 (+ 3587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:42823: BlockingRecv error: recv got EOF from 127.18.112.65:42823 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:41.141499 358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:41.133307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:54593)
0810 03:13:41.133794 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:41.133810 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:41.133929 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:41.134271 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:41.134275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:41.134653 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:41.134810 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.134819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.135769 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.135772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.136773 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.136787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.137464 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.137468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.137634 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.138276 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:41.138293 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:41.141177 (+ 2884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":262,"threads_started":1}
W20260810 03:13:41.141634 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:41.133343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:54593 (local address 127.18.112.126:43623)
0810 03:13:41.133496 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:41.133500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:41.133874 (+ 374us) server_negotiation.cc:407] Connection header received
0810 03:13:41.134073 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:41.134077 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:41.134142 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:41.134222 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:41.134915 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.135658 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.136894 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.137347 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.137473 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.141399 (+ 3926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:54593: BlockingRecv error: recv got EOF from 127.18.112.66:54593 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:41.571319 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:41.560368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:38283)
0810 03:13:41.560894 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:41.560911 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:41.561035 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:41.561296 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:41.561299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:41.561673 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:41.561826 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.561833 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.562806 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.562812 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.564107 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.564122 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.564815 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.564821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.565006 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.568440 (+ 3434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:41.568458 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:41.571080 (+ 2622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":306,"threads_started":1}
W20260810 03:13:41.571529 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:41.560449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:38283 (local address 127.18.112.126:43623)
0810 03:13:41.560622 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:41.560627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:41.560983 (+ 356us) server_negotiation.cc:407] Connection header received
0810 03:13:41.561123 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:41.561126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:41.561189 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:41.561274 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:41.561949 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.562674 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.564238 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.564674 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.564764 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.571278 (+ 6514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:38283: BlockingRecv error: recv got EOF from 127.18.112.67:38283 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:41 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:41.711913 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:41.704190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:56837)
0810 03:13:41.704701 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:41.704717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:41.704830 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:41.705082 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:41.705085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:41.705457 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:41.705617 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.705626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.706698 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.706703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.707655 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:41.707668 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.708377 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.708382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:41.708494 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.709019 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:41.709036 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:41.711640 (+ 2604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":241,"threads_started":1}
W20260810 03:13:41.712073 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:41.704215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:56837 (local address 127.18.112.126:43623)
0810 03:13:41.704375 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:41.704380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:41.704778 (+ 398us) server_negotiation.cc:407] Connection header received
0810 03:13:41.704915 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:41.704918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:41.704979 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:41.705056 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:41.705726 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.706578 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.707779 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:41.708238 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:41.708330 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:41.711867 (+ 3537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:56837: BlockingRecv error: recv got EOF from 127.18.112.65:56837 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:42.150419 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:42.142432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:49599)
0810 03:13:42.143028 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:42.143043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:42.143181 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:42.143479 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:42.143484 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:42.143926 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:42.144095 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.144104 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.145114 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.145118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.146055 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.146068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.146849 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.146855 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.147006 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.147540 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:42.147557 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:42.150177 (+ 2620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":348,"threads_started":1}
W20260810 03:13:42.150560 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:42.142593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:49599 (local address 127.18.112.126:43623)
0810 03:13:42.142792 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:42.142798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:42.143121 (+ 323us) server_negotiation.cc:407] Connection header received
0810 03:13:42.143294 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:42.143298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:42.143358 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:42.143437 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:42.144241 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.144981 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.146204 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.146676 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.146784 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.150362 (+ 3578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:49599: BlockingRecv error: recv got EOF from 127.18.112.66:49599 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:42.580466 362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:42.572208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:59831)
0810 03:13:42.572739 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:42.572755 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:42.572866 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:42.573135 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:42.573138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:42.573525 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:42.573689 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.573697 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.574693 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.574697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.575632 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.575644 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.576342 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.576348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.576501 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.577228 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:42.577246 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:42.580215 (+ 2969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":257,"threads_started":1}
W20260810 03:13:42.580606 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:42.572269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:59831 (local address 127.18.112.126:43623)
0810 03:13:42.572441 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:42.572445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:42.572839 (+ 394us) server_negotiation.cc:407] Connection header received
0810 03:13:42.572969 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:42.572973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:42.573035 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:42.573103 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:42.573844 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.574566 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.575754 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.576174 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.576263 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.580401 (+ 4138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:59831: BlockingRecv error: recv got EOF from 127.18.112.67:59831 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:42 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:42.720647 363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:42.712803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:33205)
0810 03:13:42.713233 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:42.713250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:42.713362 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:42.713672 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:42.713676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:42.714089 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:42.714269 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.714279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.715365 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.715369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.716322 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:42.716335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.716992 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.716998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:42.717157 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.717681 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:42.717697 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:42.720296 (+ 2599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":226,"threads_started":1}
W20260810 03:13:42.720743 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:42.712859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:33205 (local address 127.18.112.126:43623)
0810 03:13:42.713120 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:42.713126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:42.713316 (+ 190us) server_negotiation.cc:407] Connection header received
0810 03:13:42.713463 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:42.713466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:42.713529 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:42.713599 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:42.714417 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.715228 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.716454 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:42.716856 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:42.716966 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:42.720508 (+ 3542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:33205: BlockingRecv error: recv got EOF from 127.18.112.65:33205 (error 108)
Metrics: {"server-negotiator.queue_time_us":131}
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:43.158999 364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:43.151260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:59775)
0810 03:13:43.151723 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:43.151739 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:43.151886 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:43.152163 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:43.152167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:43.152532 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:43.152710 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.152719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.153644 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.153647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.154563 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.154575 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.155201 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.155205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.155323 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.155929 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:43.155947 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:43.158710 (+ 2763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":239,"threads_started":1}
W20260810 03:13:43.159003 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:43.151336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:59775 (local address 127.18.112.126:43623)
0810 03:13:43.151488 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:43.151504 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:43.151819 (+ 315us) server_negotiation.cc:407] Connection header received
0810 03:13:43.151981 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:43.151984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:43.152045 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:43.152121 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:43.152815 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.153540 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.154670 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.155093 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.155183 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.158826 (+ 3643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:59775: BlockingRecv error: recv got EOF from 127.18.112.66:59775 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.67@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:43.589277 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:43.581286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.67:60963)
0810 03:13:43.581719 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:43.581736 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:43.581850 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:43.582106 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:43.582109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:43.582468 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:43.582655 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.582664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.583592 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.583596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.584943 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.584956 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.585649 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.585654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.585772 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.586311 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:43.586327 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:43.588971 (+ 2644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
W20260810 03:13:43.589417 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:43.581348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:60963 (local address 127.18.112.126:43623)
0810 03:13:43.581535 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:43.581539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:43.581804 (+ 265us) server_negotiation.cc:407] Connection header received
0810 03:13:43.581937 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:43.581940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:43.582001 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:43.582078 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:43.582766 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.583472 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.585102 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.585527 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.585619 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.589192 (+ 3573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.67:60963: BlockingRecv error: recv got EOF from 127.18.112.67:60963 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:43 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.65@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:43.729933 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:43.721826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.65:42971)
0810 03:13:43.722355 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:43.722375 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:43.722516 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:43.722996 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:43.723001 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:43.723431 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:43.723597 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.723606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.724708 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.724711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.725606 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:43.725616 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.726265 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.726272 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:43.726380 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.726914 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:43.726931 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:43.729590 (+ 2659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":267,"threads_started":1}
W20260810 03:13:43.730034 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:43.721882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:42971 (local address 127.18.112.126:43623)
0810 03:13:43.722101 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:43.722108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:43.722459 (+ 351us) server_negotiation.cc:407] Connection header received
0810 03:13:43.722636 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:43.722641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:43.722718 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:43.722823 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:43.723736 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.724608 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.725743 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:43.726154 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:43.726244 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:43.729820 (+ 3576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.65:42971: BlockingRecv error: recv got EOF from 127.18.112.65:42971 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 03:13:44 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:13:44 dist-test-slave-jlzn krb5kdc[31251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.112.66@KRBTEST.COM for oryx/127.18.112.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:13:44.168035 368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:44.160104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:43623 (local address 127.18.112.66:52681)
0810 03:13:44.160585 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:44.160601 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:44.160727 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:44.161056 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:44.161062 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:44.161481 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:44.161645 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:44.161654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.162656 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.162660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:44.163581 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:44.163593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.164374 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.164380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:44.164532 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:44.165048 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:44.165065 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:44.167734 (+ 2669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.112.126:43623: Server oryx/127.18.112.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":261,"threads_started":1}
W20260810 03:13:44.168166 32376 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:44.160177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52681 (local address 127.18.112.126:43623)
0810 03:13:44.160371 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:44.160377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:44.160685 (+ 308us) server_negotiation.cc:407] Connection header received
0810 03:13:44.160836 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:44.160842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:44.160908 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:44.160994 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:44.161789 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.162514 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.163722 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.164238 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.164349 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:44.167947 (+ 3598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.112.66:52681: BlockingRecv error: recv got EOF from 127.18.112.66:52681 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:13:44.432633 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32142
I20260810 03:13:44.443744 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:44.433575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.18.112.65:36785)
0810 03:13:44.434114 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:44.434121 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:44.434154 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:13:44.434218 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:44.434225 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:44.434434 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:44.434589 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:44.435936 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.436946 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.438110 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.438653 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.438747 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:44.441009 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:44.441017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:44.441031 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:44.441062 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:44.443288 (+ 2226us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 03:13:44.443524 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44102: Request ticket server kudu/127.18.112.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":257,"threads_started":1}
W20260810 03:13:44.443862 370 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44102: Request ticket server kudu/127.18.112.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 03:13:44.443907 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32142: Not authorized: Client connection negotiation failed: client connection to 127.18.112.65:36785: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 03:13:44.444082 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 32142
I20260810 03:13:44.466238 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32379
I20260810 03:13:44.477147 372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:44.467109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.18.112.66:42853)
0810 03:13:44.467678 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:44.467686 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:44.467716 (+ 30us) server_negotiation.cc:407] Connection header received
0810 03:13:44.467771 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:44.467778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:44.468039 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:44.468185 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:44.469344 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.470373 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.471457 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.472043 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.472140 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:44.474382 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:44.474391 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:44.474403 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:44.474435 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:44.476625 (+ 2190us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 03:13:44.476894 (+ 269us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33280: Request ticket server kudu/127.18.112.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":252,"threads_started":1}
W20260810 03:13:44.477249 372 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33280: Request ticket server kudu/127.18.112.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 03:13:44.477234 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32379: Not authorized: Client connection negotiation failed: client connection to 127.18.112.66:42853: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 03:13:44.477389 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 32379
I20260810 03:13:44.499409 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32574
I20260810 03:13:44.510341 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:44.500220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.18.112.67:42393)
0810 03:13:44.500773 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:44.500780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:44.500805 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:13:44.500862 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:44.500868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:44.501088 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:44.501241 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:44.502360 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.503356 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.504525 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:44.505063 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:44.505159 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:44.507415 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:44.507424 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:44.507438 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:44.507470 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:44.509865 (+ 2395us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 03:13:44.510102 (+ 237us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44444: Request ticket server kudu/127.18.112.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":265,"threads_started":1}
W20260810 03:13:44.510452 373 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44444: Request ticket server kudu/127.18.112.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 03:13:44.510437 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32574: Not authorized: Client connection negotiation failed: client connection to 127.18.112.67:42393: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.18.112.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 03:13:44.510572 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 32574
I20260810 03:13:44.538298 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 32036
I20260810 03:13:44.539515 32130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:44.652341 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 32036
2026-08-10T03:13:44Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (20977 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T03:13:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:44Z Disabled control of system clock
I20260810 03:13:44.734413 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:45455
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:37739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:45455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 03:13:45.050853 386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:45.051118 386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:45.051237 386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:45.058310 386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:45.058409 386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:45.058475 386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:45.058555 386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:45.058624 386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:45.067423 386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:45455
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:45455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:45.068596 386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:45.070266 386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:45.081197 401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:45.081207 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:45.081246 398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:45.082084 386 server_base.cc:1034] running on GCE node
I20260810 03:13:45.082777 386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:45.084045 386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:45.085237 386 hybrid_clock.cc:648] HybridClock initialized: now 1786331625085197 us; error 35 us; skew 500 ppm
I20260810 03:13:45.085544 386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:45.087625 386 webserver.cc:460] Webserver started at http://127.18.112.126:43281/ using document root <none> and password file <none>
I20260810 03:13:45.088292 386 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:45.088393 386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:45.088708 386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:45.091349 386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "94d3f55767a8485b94ed0c3e4ef1491a"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "99126be13d3bb03a195cd3f9748c1668"
server_key_iv: "36c22e499c7f36c17e8a133573d38bf1"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.092137 386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "94d3f55767a8485b94ed0c3e4ef1491a"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "99126be13d3bb03a195cd3f9748c1668"
server_key_iv: "36c22e499c7f36c17e8a133573d38bf1"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.096732 386 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:13:45.099848 408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:45.101042 386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:13:45.101193 386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "94d3f55767a8485b94ed0c3e4ef1491a"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "99126be13d3bb03a195cd3f9748c1668"
server_key_iv: "36c22e499c7f36c17e8a133573d38bf1"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.101384 386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:45.121529 386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:45.122262 386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:45.122516 386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:45.138681 386 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:45455
I20260810 03:13:45.138700 495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:45455 every 8 connection(s)
I20260810 03:13:45.139915 386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:45.143431 496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:45.146004 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 386
I20260810 03:13:45.146198 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:45.146811 18881 external_mini_cluster.cc:1428] Setting key b33841cb17119a103376f9d35ea63c42
I20260810 03:13:45.154507 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a: Bootstrap starting.
I20260810 03:13:45.157419 496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:45.158466 496 log.cc:824] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:45.159168 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:45.148726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34378 (local address 127.18.112.126:45455)
0810 03:13:45.149573 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:45.149583 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:45.149623 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:13:45.151215 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:45.151235 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:45.151668 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:45.152054 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:45.152622 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.153815 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.155084 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.155756 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.155978 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:45.157030 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:45.157037 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:45.157049 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:45.157549 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:45.157650 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:45.157672 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:45.157785 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:45.157990 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 03:13:45.158278 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":304,"threads_started":1}
I20260810 03:13:45.161424 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a: No bootstrap required, opened a new log
I20260810 03:13:45.168632 496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } }
I20260810 03:13:45.168936 496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:45.169018 496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94d3f55767a8485b94ed0c3e4ef1491a, State: Initialized, Role: FOLLOWER
I20260810 03:13:45.169492 496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } }
I20260810 03:13:45.169685 496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:45.169780 496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:45.169891 496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:45.171864 496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } }
I20260810 03:13:45.172286 496 leader_election.cc:302] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94d3f55767a8485b94ed0c3e4ef1491a; no voters:
I20260810 03:13:45.172791 496 leader_election.cc:288] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:45.172907 502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:45.173867 502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [term 1 LEADER]: Becoming Leader. State: Replica: 94d3f55767a8485b94ed0c3e4ef1491a, State: Running, Role: LEADER
I20260810 03:13:45.174443 502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } }
I20260810 03:13:45.174762 496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:45.177027 503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } } }
I20260810 03:13:45.177455 503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:45.177780 505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94d3f55767a8485b94ed0c3e4ef1491a. Latest consensus state: current_term: 1 leader_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94d3f55767a8485b94ed0c3e4ef1491a" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 45455 } } }
I20260810 03:13:45.178078 505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:45.180462 515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:45.185307 515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:45.193174 515 catalog_manager.cc:1347] Generated new cluster ID: 3146b5b962004964a3ee9b37badf5d3a
I20260810 03:13:45.193272 515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:45.206284 515 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:45.207988 515 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:45.216961 515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94d3f55767a8485b94ed0c3e4ef1491a: Generated new TSK 0
I20260810 03:13:45.217787 515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:13:45.231087 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--builtin_ntp_servers=127.18.112.84:37739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 03:13:45.550756 529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:45.551033 529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:45.551152 529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:45.558175 529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:45.558281 529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:45.558423 529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:45.567058 529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:45.568284 529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:45.569979 529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:45.582371 543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:45.582401 550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:45.582794 544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:45.583241 529 server_base.cc:1034] running on GCE node
I20260810 03:13:45.583869 529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:45.584928 529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:45.586126 529 hybrid_clock.cc:648] HybridClock initialized: now 1786331625586077 us; error 48 us; skew 500 ppm
I20260810 03:13:45.586421 529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:45.588593 529 webserver.cc:460] Webserver started at http://127.18.112.65:40535/ using document root <none> and password file <none>
I20260810 03:13:45.589215 529 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:45.589318 529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:45.589633 529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:45.592374 529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "811f64055f9a4f64bdcda0bb2c3de3b7"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "ba63ea6d2dbc137a67ebf92f21849a3a"
server_key_iv: "ae2428f38c6a3117634dc9b5cfada836"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.593150 529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "811f64055f9a4f64bdcda0bb2c3de3b7"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "ba63ea6d2dbc137a67ebf92f21849a3a"
server_key_iv: "ae2428f38c6a3117634dc9b5cfada836"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.598016 529 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:13:45.601161 560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:45.602339 529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:13:45.602511 529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "811f64055f9a4f64bdcda0bb2c3de3b7"
format_stamp: "Formatted at 2026-08-10 03:13:45 on dist-test-slave-jlzn"
server_key: "ba63ea6d2dbc137a67ebf92f21849a3a"
server_key_iv: "ae2428f38c6a3117634dc9b5cfada836"
server_key_version: "encryptionkey@0"
I20260810 03:13:45.602687 529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:45.622390 529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:45.623080 529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:45.623322 529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:45.624181 529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:45.625484 529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:45.625594 529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:45.625700 529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:45.625772 529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:45.654227 529 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:34037
I20260810 03:13:45.654300 724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:34037 every 8 connection(s)
I20260810 03:13:45.655400 529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:45.655992 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 529
I20260810 03:13:45.656221 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:45.656984 18881 external_mini_cluster.cc:1428] Setting key 9049c047079639504dc1d3050baeb010
I20260810 03:13:45.660056 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--builtin_ntp_servers=127.18.112.84:37739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 03:13:45.667372 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:45.658070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:50365 (local address 127.18.112.126:45455)
0810 03:13:45.658294 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:45.658301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:45.659578 (+ 1277us) server_negotiation.cc:407] Connection header received
0810 03:13:45.661365 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:45.661371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:45.661452 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:45.661554 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:45.662569 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.663264 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.664804 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.665199 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.665310 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:45.666639 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:45.666644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:45.666647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:45.666664 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:45.666696 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:45.666707 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:45.666782 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:45.666983 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 03:13:45.667081 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:13:45.668309 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:45.658497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:45455 (local address 127.18.112.65:50365)
0810 03:13:45.659433 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:45.659466 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:45.661110 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:45.661771 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:45.661779 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:45.661857 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:45.662399 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:45.662416 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.663421 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.663425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:45.664664 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:45.664676 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:45.665409 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:45.665417 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:45.665631 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:45.666348 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:45.666351 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:45.666386 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:45.666462 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:45.666794 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:45.666805 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:45.666814 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 03:13:45.666960 (+ 146us) client_negotiation.cc:240] Negotiation successful
0810 03:13:45.667324 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":299,"threads_started":1}
I20260810 03:13:45.669616 727 heartbeater.cc:347] Connected to a master server at 127.18.112.126:45455
I20260810 03:13:45.669917 727 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:45.670786 727 heartbeater.cc:511] Master 127.18.112.126:45455 requested a full tablet report, sending...
I20260810 03:13:45.672698 433 ts_manager.cc:194] Registered new tserver with Master: 811f64055f9a4f64bdcda0bb2c3de3b7 (127.18.112.65:34037)
I20260810 03:13:45.674109 433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.65:50365
W20260810 03:13:45.975047 730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:45.975325 730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:45.975448 730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:45.982414 730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:45.982510 730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:45.982659 730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:45.991060 730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:45.992224 730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:45.993829 730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:46.005908 736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:46.005944 739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:46.005864 737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:46.006695 730 server_base.cc:1034] running on GCE node
I20260810 03:13:46.007261 730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:46.008138 730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:46.009335 730 hybrid_clock.cc:648] HybridClock initialized: now 1786331626009294 us; error 36 us; skew 500 ppm
I20260810 03:13:46.009634 730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:46.011618 730 webserver.cc:460] Webserver started at http://127.18.112.66:42185/ using document root <none> and password file <none>
I20260810 03:13:46.012264 730 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:46.012362 730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:46.012670 730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:46.015250 730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "d8be7271b02b47519eec87bac616ef2f"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "58c309b3dcc2658faf7c34ca00b8f7f8"
server_key_iv: "126adc85dbc5022b2560966b7875e613"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.016013 730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "d8be7271b02b47519eec87bac616ef2f"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "58c309b3dcc2658faf7c34ca00b8f7f8"
server_key_iv: "126adc85dbc5022b2560966b7875e613"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.020604 730 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:13:46.023653 746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.024827 730 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:13:46.024973 730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "d8be7271b02b47519eec87bac616ef2f"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "58c309b3dcc2658faf7c34ca00b8f7f8"
server_key_iv: "126adc85dbc5022b2560966b7875e613"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.025162 730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:46.052130 730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:46.052871 730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:46.053133 730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:46.053969 730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:46.055277 730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:46.055371 730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.055475 730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:46.055567 730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.084420 730 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:41279
I20260810 03:13:46.084486 905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:41279 every 8 connection(s)
I20260810 03:13:46.085551 730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:46.093983 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 730
I20260810 03:13:46.094172 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:46.094604 18881 external_mini_cluster.cc:1428] Setting key 72e92399f6e84fa585561ee02a92ddd2
I20260810 03:13:46.096935 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.087715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:36323 (local address 127.18.112.126:45455)
0810 03:13:46.087950 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.087957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.089223 (+ 1266us) server_negotiation.cc:407] Connection header received
0810 03:13:46.090823 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.090827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.090891 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.090973 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.091890 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.092618 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.094290 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.094716 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.094807 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.096177 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:46.096182 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:46.096185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:46.096202 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:46.096233 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:46.096244 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:46.096317 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:46.096524 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 03:13:46.096625 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:13:46.097258 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--builtin_ntp_servers=127.18.112.84:37739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 03:13:46.097779 910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.088236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:45455 (local address 127.18.112.66:36323)
0810 03:13:46.089074 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:46.089106 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:46.090609 (+ 1503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:46.091149 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:46.091156 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:46.091233 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:46.091761 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:46.091776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.092745 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.092749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:46.094156 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:46.094172 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.094939 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.094947 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:46.095218 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.095894 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:46.095897 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:46.095932 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:46.096000 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:46.096328 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:46.096339 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:46.096347 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 03:13:46.096482 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 03:13:46.096817 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":275,"threads_started":1}
I20260810 03:13:46.099000 907 heartbeater.cc:347] Connected to a master server at 127.18.112.126:45455
I20260810 03:13:46.099287 907 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:46.100098 907 heartbeater.cc:511] Master 127.18.112.126:45455 requested a full tablet report, sending...
I20260810 03:13:46.101405 433 ts_manager.cc:194] Registered new tserver with Master: d8be7271b02b47519eec87bac616ef2f (127.18.112.66:41279)
I20260810 03:13:46.102165 433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.66:36323
W20260810 03:13:46.414114 912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:46.414368 912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:46.414479 912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:46.421312 912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:46.421401 912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:46.421530 912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:46.430125 912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:45455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:46.431218 912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:46.432862 912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:46.444865 925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:46.444911 928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:46.444896 926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:46.445432 912 server_base.cc:1034] running on GCE node
I20260810 03:13:46.446043 912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:46.446884 912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:46.448084 912 hybrid_clock.cc:648] HybridClock initialized: now 1786331626448041 us; error 28 us; skew 500 ppm
I20260810 03:13:46.448379 912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:46.450438 912 webserver.cc:460] Webserver started at http://127.18.112.67:42465/ using document root <none> and password file <none>
I20260810 03:13:46.451045 912 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:46.451157 912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:46.451447 912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:46.454092 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "29c063aded3841119719f9a2a7283158"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "91dba041c948e6617c3202aee969a45a"
server_key_iv: "fabfbce3e0207a694ea19974c0ee5652"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.454843 912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "29c063aded3841119719f9a2a7283158"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "91dba041c948e6617c3202aee969a45a"
server_key_iv: "fabfbce3e0207a694ea19974c0ee5652"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.459580 912 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260810 03:13:46.462735 935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.463940 912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:46.464090 912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "29c063aded3841119719f9a2a7283158"
format_stamp: "Formatted at 2026-08-10 03:13:46 on dist-test-slave-jlzn"
server_key: "91dba041c948e6617c3202aee969a45a"
server_key_iv: "fabfbce3e0207a694ea19974c0ee5652"
server_key_version: "encryptionkey@0"
I20260810 03:13:46.464287 912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:46.489460 912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:46.490157 912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:46.490422 912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:46.491302 912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:46.492672 912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:46.492769 912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.492864 912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:46.492935 912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:46.522027 912 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:42771
I20260810 03:13:46.522113 1114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:42771 every 8 connection(s)
I20260810 03:13:46.523152 912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:46.531574 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 912
I20260810 03:13:46.531735 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:46.532152 18881 external_mini_cluster.cc:1428] Setting key bbf18a6be362cc4b56182884c3438e70
I20260810 03:13:46.534916 499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.525480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:57863 (local address 127.18.112.126:45455)
0810 03:13:46.525651 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.525655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.526922 (+ 1267us) server_negotiation.cc:407] Connection header received
0810 03:13:46.528705 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.528710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.528790 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.528877 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.529894 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.530611 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.532208 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.532638 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.532772 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.534135 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:46.534141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:46.534146 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:46.534168 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:46.534210 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:46.534226 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:46.534315 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:46.534498 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 03:13:46.534595 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:13:46.535789 1117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.525921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:45455 (local address 127.18.112.67:57863)
0810 03:13:46.526775 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:46.526809 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:46.528437 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:46.529107 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:46.529115 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:46.529201 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:46.529732 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:46.529749 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.530767 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.530771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:46.532072 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:46.532085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.532854 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.532862 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:46.533144 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.533812 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:46.533814 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:46.533849 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:46.533939 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:46.534312 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:46.534320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:46.534325 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:13:46.534460 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 03:13:46.534737 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":286,"threads_started":1}
I20260810 03:13:46.536932 1115 heartbeater.cc:347] Connected to a master server at 127.18.112.126:45455
I20260810 03:13:46.537184 1115 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:46.537851 1115 heartbeater.cc:511] Master 127.18.112.126:45455 requested a full tablet report, sending...
I20260810 03:13:46.539063 433 ts_manager.cc:194] Registered new tserver with Master: 29c063aded3841119719f9a2a7283158 (127.18.112.67:42771)
I20260810 03:13:46.539860 433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.67:57863
I20260810 03:13:46.546944 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:13:46.552762 499 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:46.551249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34382 (local address 127.18.112.126:45455)
0810 03:13:46.551416 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.551422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.551984 (+ 562us) server_negotiation.cc:407] Connection header received
0810 03:13:46.552132 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.552135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.552224 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.552294 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.552576 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34382: BlockingRecv error: recv got EOF from 127.0.0.1:34382 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:13:46.553531 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 529
I20260810 03:13:46.560220 1125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.554308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.18.112.65:34037)
0810 03:13:46.554754 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.554761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.554785 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:13:46.554852 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.554857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.555027 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.555147 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.555449 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.556435 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.557591 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.558100 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.558188 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.559043 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:46.559050 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:46.559060 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:46.559562 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:46.559607 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:46.559626 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:46.559715 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:46.559791 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 03:13:46.559939 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":224,"threads_started":1}
I20260810 03:13:46.561287 720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:46.640851 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 529
I20260810 03:13:46.662650 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 730
I20260810 03:13:46.672703 1127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.663446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.18.112.66:41279)
0810 03:13:46.664010 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.664017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.664046 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:13:46.664114 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.664121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.664327 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.664461 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.664774 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.665788 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.666948 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.667526 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.667649 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.671362 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:46.671370 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:46.671383 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:46.672017 (+ 634us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:46.672064 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:46.672098 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:46.672185 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:46.672284 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 03:13:46.672398 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":279,"threads_started":1}
I20260810 03:13:46.673841 901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:46.753170 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 730
I20260810 03:13:46.773731 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 912
I20260810 03:13:46.781936 1132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:46.774668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60166 (local address 127.18.112.67:42771)
0810 03:13:46.775298 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:46.775312 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:46.775342 (+ 30us) server_negotiation.cc:407] Connection header received
0810 03:13:46.775400 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:46.775406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:46.775617 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:46.775769 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:46.776265 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.777435 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.778761 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:46.779307 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:46.779429 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:46.780560 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:46.780568 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:46.780581 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:46.781137 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:46.781183 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:46.781203 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:46.781305 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:46.781473 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:13:46.781611 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":338,"threads_started":1}
I20260810 03:13:46.783123 1109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:46.862349 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 912
I20260810 03:13:46.886763 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 386
I20260810 03:13:46.887928 489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:46.985345 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 386
2026-08-10T03:13:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2323 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T03:13:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:47Z Disabled control of system clock
I20260810 03:13:47.057822 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33337
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:13:47.368621 1138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:47.368882 1138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:47.369010 1138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:47.376122 1138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:47.376219 1138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:47.376283 1138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:47.376364 1138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:47.376427 1138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:47.385568 1138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33337
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:47.386678 1138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:47.388370 1138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:47.399359 1145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:47.399325 1150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:47.399284 1146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:47.400206 1138 server_base.cc:1034] running on GCE node
I20260810 03:13:47.400885 1138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:47.402055 1138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:47.403254 1138 hybrid_clock.cc:648] HybridClock initialized: now 1786331627403204 us; error 38 us; skew 500 ppm
I20260810 03:13:47.403573 1138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:47.405674 1138 webserver.cc:460] Webserver started at http://127.18.112.126:37483/ using document root <none> and password file <none>
I20260810 03:13:47.406291 1138 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:47.406384 1138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:47.406682 1138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:47.409379 1138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "aff530aa1fc4491999d4149180799221"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "367e7c3ee8da112b605da6a0d41873d9"
server_key_iv: "1148ea3e8eb4591abb60398e3265eb12"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.410149 1138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "aff530aa1fc4491999d4149180799221"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "367e7c3ee8da112b605da6a0d41873d9"
server_key_iv: "1148ea3e8eb4591abb60398e3265eb12"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.415004 1138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 03:13:47.418201 1160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:47.419354 1138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:47.419507 1138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "aff530aa1fc4491999d4149180799221"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "367e7c3ee8da112b605da6a0d41873d9"
server_key_iv: "1148ea3e8eb4591abb60398e3265eb12"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.419706 1138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:47.425144 1138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:47.425824 1138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:47.426082 1138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:47.441462 1138 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:33337
I20260810 03:13:47.441502 1237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:33337 every 8 connection(s)
I20260810 03:13:47.442626 1138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:47.445539 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 1138
I20260810 03:13:47.445719 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:47.446157 1239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:47.446376 18881 external_mini_cluster.cc:1428] Setting key 1c545614c2f03b014a778c8afe3259f3
I20260810 03:13:47.454833 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:47.448172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34916 (local address 127.18.112.126:33337)
0810 03:13:47.449309 (+ 1137us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:47.449323 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:47.449374 (+ 51us) server_negotiation.cc:407] Connection header received
0810 03:13:47.451042 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:47.451072 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:47.451606 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:47.452040 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:47.453015 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:47.453023 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:47.453038 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:47.453062 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:47.453126 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:47.453147 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:47.453374 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:47.453507 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 03:13:47.453759 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":378,"threads_started":1}
I20260810 03:13:47.459926 1239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221: Bootstrap starting.
I20260810 03:13:47.462852 1239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:47.463788 1239 log.cc:824] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:47.466140 1239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221: No bootstrap required, opened a new log
I20260810 03:13:47.473067 1239 raft_consensus.cc:348] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } }
I20260810 03:13:47.473363 1239 raft_consensus.cc:374] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:47.473434 1239 raft_consensus.cc:729] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff530aa1fc4491999d4149180799221, State: Initialized, Role: FOLLOWER
I20260810 03:13:47.473908 1239 consensus_queue.cc:260] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } }
I20260810 03:13:47.474102 1239 raft_consensus.cc:388] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:47.474213 1239 raft_consensus.cc:482] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:47.474339 1239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:47.476598 1239 raft_consensus.cc:504] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } }
I20260810 03:13:47.477021 1239 leader_election.cc:302] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aff530aa1fc4491999d4149180799221; no voters:
I20260810 03:13:47.477527 1239 leader_election.cc:288] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:47.477645 1249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:47.478269 1249 raft_consensus.cc:686] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [term 1 LEADER]: Becoming Leader. State: Replica: aff530aa1fc4491999d4149180799221, State: Running, Role: LEADER
I20260810 03:13:47.478797 1249 consensus_queue.cc:237] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } }
I20260810 03:13:47.479337 1239 sys_catalog.cc:564] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:47.481415 1251 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aff530aa1fc4491999d4149180799221. Latest consensus state: current_term: 1 leader_uuid: "aff530aa1fc4491999d4149180799221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } } }
I20260810 03:13:47.481392 1250 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aff530aa1fc4491999d4149180799221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff530aa1fc4491999d4149180799221" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33337 } } }
I20260810 03:13:47.481810 1251 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:47.481927 1250 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:47.483371 1258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:47.488205 1258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:47.496762 1258 catalog_manager.cc:1347] Generated new cluster ID: d8a36dad7d054e22b1e898136be6f84c
I20260810 03:13:47.496865 1258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:47.532262 1258 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:47.532716 1258 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:47.545995 1258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aff530aa1fc4491999d4149180799221: Generated new TSK 0
I20260810 03:13:47.546892 1258 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:13:47.551429 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--builtin_ntp_servers=127.18.112.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:13:47.871281 1278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:47.871554 1278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:47.871692 1278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:47.878697 1278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:47.878793 1278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:47.878939 1278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:47.887787 1278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:47.888973 1278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:47.890642 1278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:47.902642 1283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:47.902683 1285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:47.902704 1287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:47.903716 1278 server_base.cc:1034] running on GCE node
I20260810 03:13:47.904253 1278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:47.905030 1278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:47.906212 1278 hybrid_clock.cc:648] HybridClock initialized: now 1786331627906161 us; error 46 us; skew 500 ppm
I20260810 03:13:47.906479 1278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:47.908509 1278 webserver.cc:460] Webserver started at http://127.18.112.65:46567/ using document root <none> and password file <none>
I20260810 03:13:47.909119 1278 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:47.909212 1278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:47.909507 1278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:47.912168 1278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "51f607ed5da7451aaf667d57d40d6a07"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "aed1b99132f0443762f3ec2c961cb2b9"
server_key_iv: "fca28e7d6a15c3a64289482a6c6e30c8"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.912911 1278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "51f607ed5da7451aaf667d57d40d6a07"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "aed1b99132f0443762f3ec2c961cb2b9"
server_key_iv: "fca28e7d6a15c3a64289482a6c6e30c8"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.917690 1278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:47.920754 1300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:47.921933 1278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:13:47.922081 1278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "51f607ed5da7451aaf667d57d40d6a07"
format_stamp: "Formatted at 2026-08-10 03:13:47 on dist-test-slave-jlzn"
server_key: "aed1b99132f0443762f3ec2c961cb2b9"
server_key_iv: "fca28e7d6a15c3a64289482a6c6e30c8"
server_key_version: "encryptionkey@0"
I20260810 03:13:47.922286 1278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:47.927523 1278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:47.928397 1278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:47.928642 1278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:47.929550 1278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:47.930819 1278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:47.930918 1278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:47.931020 1278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:47.931087 1278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:47.960294 1278 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:43283
I20260810 03:13:47.960359 1471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:43283 every 8 connection(s)
I20260810 03:13:47.961493 1278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:47.966878 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 1278
I20260810 03:13:47.967062 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:47.967933 18881 external_mini_cluster.cc:1428] Setting key 84fb93bb18da6e1d48d9c606bc369893
I20260810 03:13:47.969538 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:47.963886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:52397 (local address 127.18.112.126:33337)
0810 03:13:47.964308 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:47.964312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:47.965385 (+ 1073us) server_negotiation.cc:407] Connection header received
0810 03:13:47.967288 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:47.967292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:47.967348 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:47.967439 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:47.968793 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:47.968797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:47.968801 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:47.968821 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:47.968862 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:47.968874 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:47.968979 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:47.969164 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 03:13:47.969230 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":208,"threads_started":1}
I20260810 03:13:47.970393 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:47.964329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33337 (local address 127.18.112.65:52397)
0810 03:13:47.965234 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:47.965274 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:47.967000 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:47.967695 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:47.967707 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:47.967843 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:47.968490 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:47.968493 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:47.968539 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:47.968621 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:47.968962 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:47.968973 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:47.968981 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 03:13:47.969226 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 03:13:47.969454 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":257,"threads_started":1}
I20260810 03:13:47.970691 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--builtin_ntp_servers=127.18.112.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 03:13:47.971843 1472 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33337
I20260810 03:13:47.972095 1472 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:47.972613 1472 heartbeater.cc:511] Master 127.18.112.126:33337 requested a full tablet report, sending...
I20260810 03:13:47.974588 1187 ts_manager.cc:194] Registered new tserver with Master: 51f607ed5da7451aaf667d57d40d6a07 (127.18.112.65:43283)
W20260810 03:13:48.284557 1476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:48.284802 1476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:48.284896 1476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:48.291706 1476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:48.291792 1476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:48.291917 1476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:48.300679 1476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:48.302023 1476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:48.304172 1476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:48.316253 1490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:48.316334 1484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:48.316290 1485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:48.317132 1476 server_base.cc:1034] running on GCE node
I20260810 03:13:48.317684 1476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:48.318512 1476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:48.319703 1476 hybrid_clock.cc:648] HybridClock initialized: now 1786331628319650 us; error 44 us; skew 500 ppm
I20260810 03:13:48.319998 1476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:48.322011 1476 webserver.cc:460] Webserver started at http://127.18.112.66:42037/ using document root <none> and password file <none>
I20260810 03:13:48.322654 1476 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:48.322754 1476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:48.323045 1476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:48.328230 1476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "1328b62d7dad4c889b306265fcd61c1a"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "13b3bb684e386ac04049c0b42761e75c"
server_key_iv: "c7a81dd38412c2675ddf2b7c2da99ef0"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.328969 1476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "1328b62d7dad4c889b306265fcd61c1a"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "13b3bb684e386ac04049c0b42761e75c"
server_key_iv: "c7a81dd38412c2675ddf2b7c2da99ef0"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.333631 1476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:48.336764 1498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.337944 1476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:48.338081 1476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "1328b62d7dad4c889b306265fcd61c1a"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "13b3bb684e386ac04049c0b42761e75c"
server_key_iv: "c7a81dd38412c2675ddf2b7c2da99ef0"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.338276 1476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:48.343508 1476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:48.344262 1476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:48.344499 1476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:48.345312 1476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:48.346577 1476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:48.346671 1476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.346781 1476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:48.346849 1476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.375742 1476 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:41743
I20260810 03:13:48.375823 1657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:41743 every 8 connection(s)
I20260810 03:13:48.376911 1476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:48.383975 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.379124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:44077 (local address 127.18.112.126:33337)
0810 03:13:48.379288 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:48.379292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:48.380593 (+ 1301us) server_negotiation.cc:407] Connection header received
0810 03:13:48.382155 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:48.382159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:48.382216 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:48.382292 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:48.383363 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:48.383368 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:48.383371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:48.383388 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:48.383421 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:48.383435 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:48.383543 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:48.383663 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 03:13:48.383713 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:13:48.384773 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.379613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33337 (local address 127.18.112.66:44077)
0810 03:13:48.380468 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:48.380502 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:48.381916 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:48.382457 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:48.382464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:48.382545 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:48.383102 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:48.383104 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:48.383139 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:48.383216 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:48.383518 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:48.383523 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:48.383528 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:13:48.383725 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 03:13:48.383965 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":262,"threads_started":1}
I20260810 03:13:48.385939 1659 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33337
I20260810 03:13:48.386183 1659 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:48.386705 1659 heartbeater.cc:511] Master 127.18.112.126:33337 requested a full tablet report, sending...
I20260810 03:13:48.387087 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 1476
I20260810 03:13:48.387223 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:48.387763 18881 external_mini_cluster.cc:1428] Setting key 39999142641240ea6a63ea9e0d4bcd76
I20260810 03:13:48.388078 1187 ts_manager.cc:194] Registered new tserver with Master: 1328b62d7dad4c889b306265fcd61c1a (127.18.112.66:41743)
I20260810 03:13:48.390290 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--builtin_ntp_servers=127.18.112.84:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:13:48.706176 1665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:48.706444 1665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:48.706580 1665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:48.713893 1665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:48.713986 1665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:48.714160 1665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:48.722878 1665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:48.724057 1665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:48.725777 1665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:48.738165 1673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:48.738322 1674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:48.738356 1677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:48.739252 1665 server_base.cc:1034] running on GCE node
I20260810 03:13:48.739882 1665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:48.740725 1665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:48.741940 1665 hybrid_clock.cc:648] HybridClock initialized: now 1786331628741847 us; error 68 us; skew 500 ppm
I20260810 03:13:48.742244 1665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:13:48.744314 1665 webserver.cc:460] Webserver started at http://127.18.112.67:45949/ using document root <none> and password file <none>
I20260810 03:13:48.744982 1665 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:48.745095 1665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:48.745388 1665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:48.748111 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "e5cbd850f71c41f4879f7454a9a71924"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "e76484127f64f42d7e930a292166766c"
server_key_iv: "cefdc207e1e0c78b6f30af02d1ea19da"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.748872 1665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "e5cbd850f71c41f4879f7454a9a71924"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "e76484127f64f42d7e930a292166766c"
server_key_iv: "cefdc207e1e0c78b6f30af02d1ea19da"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.753605 1665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:48.756749 1685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.757920 1665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:48.758077 1665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "e5cbd850f71c41f4879f7454a9a71924"
format_stamp: "Formatted at 2026-08-10 03:13:48 on dist-test-slave-jlzn"
server_key: "e76484127f64f42d7e930a292166766c"
server_key_iv: "cefdc207e1e0c78b6f30af02d1ea19da"
server_key_version: "encryptionkey@0"
I20260810 03:13:48.758270 1665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:48.763859 1665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:48.764565 1665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:48.764799 1665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:48.765635 1665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:48.766885 1665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:48.766980 1665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.767093 1665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:48.767163 1665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:48.798550 1665 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:42313
I20260810 03:13:48.798592 1858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:42313 every 8 connection(s)
I20260810 03:13:48.799791 1665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:48.803197 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 1665
I20260810 03:13:48.803366 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:48.803967 18881 external_mini_cluster.cc:1428] Setting key cd4eae38554ede0754b920030b4c5c46
I20260810 03:13:48.807896 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.802160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:42827 (local address 127.18.112.126:33337)
0810 03:13:48.802398 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:48.802404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:48.803857 (+ 1453us) server_negotiation.cc:407] Connection header received
0810 03:13:48.805686 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:48.805691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:48.805760 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:48.805869 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:48.807295 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:48.807299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:48.807302 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:48.807318 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:48.807349 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:48.807360 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:48.807452 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:48.807603 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 03:13:48.807653 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:13:48.808737 1864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.802693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33337 (local address 127.18.112.67:42827)
0810 03:13:48.803698 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:48.803734 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:48.805434 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:48.806105 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:48.806116 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:48.806229 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:48.807004 (+ 775us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:13:48.807008 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:48.807053 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:13:48.807136 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:48.807435 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:48.807443 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:48.807448 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:13:48.807664 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 03:13:48.807877 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":303,"threads_started":1}
I20260810 03:13:48.809904 1860 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33337
I20260810 03:13:48.810153 1860 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:48.810662 1860 heartbeater.cc:511] Master 127.18.112.126:33337 requested a full tablet report, sending...
I20260810 03:13:48.811925 1187 ts_manager.cc:194] Registered new tserver with Master: e5cbd850f71c41f4879f7454a9a71924 (127.18.112.67:42313)
I20260810 03:13:48.818938 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:13:48.824779 1474 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:13:48.823272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34922 (local address 127.18.112.126:33337)
0810 03:13:48.823411 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:48.823415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:48.823957 (+ 542us) server_negotiation.cc:407] Connection header received
0810 03:13:48.824119 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:48.824123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:48.824178 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:48.824252 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:48.824516 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34922: BlockingRecv error: recv got EOF from 127.0.0.1:34922 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:13:48.825606 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 1278
I20260810 03:13:48.828774 1875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.826492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56412 (local address 127.18.112.65:43283)
0810 03:13:48.826994 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:48.827000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:48.827024 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:13:48.827078 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:48.827083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:48.827275 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:48.827389 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:48.828182 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:48.828187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:48.828197 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:48.828216 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:48.828255 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:48.828269 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:48.828367 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:48.828414 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 03:13:48.828493 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":261,"threads_started":1}
I20260810 03:13:48.830081 1466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:48.913939 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 1278
I20260810 03:13:48.934696 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 1476
I20260810 03:13:48.938150 1877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:48.935611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.18.112.66:41743)
0810 03:13:48.936215 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:48.936221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:48.936249 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:13:48.936311 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:48.936317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:48.936546 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:48.936672 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:48.937515 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:48.937543 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:48.937553 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:48.937567 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:48.937613 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:48.937631 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:48.937735 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:48.937787 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 03:13:48.937877 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":275,"threads_started":1}
I20260810 03:13:48.939357 1650 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:49.018306 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 1476
I20260810 03:13:49.038275 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 1665
I20260810 03:13:49.042037 1879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:49.039234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41818 (local address 127.18.112.67:42313)
0810 03:13:49.039885 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:49.039892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:49.039925 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:13:49.039997 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:49.040003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:49.040224 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:49.040345 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:49.041349 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:49.041355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:49.041366 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:13:49.041383 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:49.041422 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:13:49.041434 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:49.041561 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:49.041612 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 03:13:49.041693 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":301,"threads_started":1}
I20260810 03:13:49.043241 1851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:49.122455 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 1665
I20260810 03:13:49.147262 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 1138
I20260810 03:13:49.148572 1229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:49.252465 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 1138
2026-08-10T03:13:49Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2274 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:49 dist-test-slave-jlzn krb5kdc[1885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:49 dist-test-slave-jlzn krb5kdc[1885](info): set up 2 sockets
Aug 10 03:13:49 dist-test-slave-jlzn krb5kdc[1885](info): commencing operation
krb5kdc: starting...
W20260810 03:13:50.452397 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:50 dist-test-slave-jlzn krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:13:50.681306 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34459
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:34459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:50.997762 1905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:50.998047 1905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:50.998198 1905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:51.005102 1905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:13:51.005210 1905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:51.005290 1905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:51.005365 1905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:13:51.005430 1905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:13:51.014725 1905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:34459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:51.015988 1905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:51.017231 1905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:51.028236 1914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:51.028281 1917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:51.028312 1910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:51.029031 1905 server_base.cc:1034] running on GCE node
I20260810 03:13:51.029714 1905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:51.030936 1905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:51.032143 1905 hybrid_clock.cc:648] HybridClock initialized: now 1786331631032086 us; error 33 us; skew 500 ppm
I20260810 03:13:51.032457 1905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:51 dist-test-slave-jlzn krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331631, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:51.035422 1905 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:13:51.036775 1905 webserver.cc:460] Webserver started at http://127.18.112.126:36493/ using document root <none> and password file <none>
I20260810 03:13:51.037451 1905 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:51.037572 1905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:51.037861 1905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:51.040844 1905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "49f6bc74955041f6ad4a11bc78503d56"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "34c55171814d1a6e6343b19ed7cb6e8a"
server_key_iv: "cde5fa8d51f4839c1f885e3f88bb1839"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.041584 1905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "49f6bc74955041f6ad4a11bc78503d56"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "34c55171814d1a6e6343b19ed7cb6e8a"
server_key_iv: "cde5fa8d51f4839c1f885e3f88bb1839"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.046522 1905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 03:13:51.049799 1929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:51.050967 1905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:13:51.051146 1905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "49f6bc74955041f6ad4a11bc78503d56"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "34c55171814d1a6e6343b19ed7cb6e8a"
server_key_iv: "cde5fa8d51f4839c1f885e3f88bb1839"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.051321 1905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:51.069164 1905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:51.072715 1905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:51.072964 1905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:51.089838 1905 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:34459
I20260810 03:13:51.089857 2009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:34459 every 8 connection(s)
I20260810 03:13:51.091089 1905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:13:51.094790 2010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:51.100271 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 1905
I20260810 03:13:51.100494 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:13:51.101326 18881 external_mini_cluster.cc:1428] Setting key 1eef7b5bab67304449699bb4fde144a0
I20260810 03:13:51.105861 2010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: Bootstrap starting.
I20260810 03:13:51.108783 2010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:51.109758 2010 log.cc:824] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:51.112917 2010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: No bootstrap required, opened a new log
Aug 10 03:13:51 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:51.122380 2010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } }
I20260810 03:13:51.122963 2010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:51.123093 2010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f6bc74955041f6ad4a11bc78503d56, State: Initialized, Role: FOLLOWER
I20260810 03:13:51.123749 2010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } }
I20260810 03:13:51.124056 2010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:13:51.124209 2010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:13:51.124243 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:51.103371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51840 (local address 127.18.112.126:34459)
0810 03:13:51.104143 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:51.104155 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:51.104194 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:13:51.105763 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:51.105785 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:51.106174 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:51.106501 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:51.108005 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.109307 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.110780 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.111739 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.111943 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:51.115914 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:51.115925 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:51.115943 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:51.116007 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:51.119836 (+ 3829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:51.120491 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:51.120500 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:51.120509 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:51.120736 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:51.121089 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:51.121094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:51.121097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:51.121809 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:51.122115 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:51.122385 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 03:13:51.122899 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":355,"threads_started":1}
I20260810 03:13:51.124413 2010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:51.126732 2010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } }
I20260810 03:13:51.127192 2010 leader_election.cc:302] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49f6bc74955041f6ad4a11bc78503d56; no voters:
I20260810 03:13:51.127704 2010 leader_election.cc:288] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:13:51.127848 2018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:51.128477 2018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [term 1 LEADER]: Becoming Leader. State: Replica: 49f6bc74955041f6ad4a11bc78503d56, State: Running, Role: LEADER
I20260810 03:13:51.128991 2018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } }
I20260810 03:13:51.129724 2010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:13:51.131784 2020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49f6bc74955041f6ad4a11bc78503d56. Latest consensus state: current_term: 1 leader_uuid: "49f6bc74955041f6ad4a11bc78503d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } } }
I20260810 03:13:51.132148 2020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:51.133550 2019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49f6bc74955041f6ad4a11bc78503d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49f6bc74955041f6ad4a11bc78503d56" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34459 } } }
I20260810 03:13:51.133805 2019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56 [sys.catalog]: This master's current role is: LEADER
I20260810 03:13:51.134354 2026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:13:51.139389 2026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:13:51.147956 2026 catalog_manager.cc:1347] Generated new cluster ID: 1718cb746fe3428aaa281534e32db308
I20260810 03:13:51.148062 2026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:13:51.159370 2026 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:13:51.160679 2026 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:13:51.170959 2026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: Generated new TSK 0
I20260810 03:13:51.171904 2026 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:13:51.231366 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:51.547914 2042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:51.548180 2042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:51.548282 2042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:51.555367 2042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:51.555464 2042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:51.555576 2042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:13:51.564649 2042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:51.565711 2042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:51.566890 2042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:51.579173 2049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:51.579125 2050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:51.579363 2052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:51.580037 2042 server_base.cc:1034] running on GCE node
I20260810 03:13:51.580595 2042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:51.581421 2042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:51.582620 2042 hybrid_clock.cc:648] HybridClock initialized: now 1786331631582569 us; error 45 us; skew 500 ppm
I20260810 03:13:51.582919 2042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:51 dist-test-slave-jlzn krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331631, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:51.585879 2042 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:13:51.587116 2042 webserver.cc:460] Webserver started at http://127.18.112.65:37183/ using document root <none> and password file <none>
I20260810 03:13:51.587704 2042 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:51.587826 2042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:51.588095 2042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:51.590740 2042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "bdb44fcb70690c55800cc931db39b990"
server_key_iv: "bad4cb66a29fc7d4dba898fc170cd5b6"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.591440 2042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "bdb44fcb70690c55800cc931db39b990"
server_key_iv: "bad4cb66a29fc7d4dba898fc170cd5b6"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.596101 2042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260810 03:13:51.599179 2063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:51.600445 2042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:13:51.600570 2042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87"
format_stamp: "Formatted at 2026-08-10 03:13:51 on dist-test-slave-jlzn"
server_key: "bdb44fcb70690c55800cc931db39b990"
server_key_iv: "bad4cb66a29fc7d4dba898fc170cd5b6"
server_key_version: "encryptionkey@0"
I20260810 03:13:51.600718 2042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:51.624356 2042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:51.627942 2042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:51.628183 2042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:51.628983 2042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:51.630302 2042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:51.630375 2042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:51.630461 2042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:51.630504 2042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:51.660182 2042 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:35171
I20260810 03:13:51.660246 2245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:35171 every 8 connection(s)
I20260810 03:13:51.661334 2042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:13:51.663079 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 2042
I20260810 03:13:51.663285 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:13:51.664040 18881 external_mini_cluster.cc:1428] Setting key 979e65e15a43267faa26e31bf11393ba
Aug 10 03:13:51 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331631, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:51.685051 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:51.663781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:33483 (local address 127.18.112.126:34459)
0810 03:13:51.664278 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:51.664284 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:51.665175 (+ 891us) server_negotiation.cc:407] Connection header received
0810 03:13:51.667334 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:51.667338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:51.667398 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:51.667485 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:51.669301 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.670027 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.672035 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.672433 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.672525 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:51.679734 (+ 7209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:51.679739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:51.679742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:51.679773 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:51.682139 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:51.682823 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:51.682828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:51.682830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:51.682953 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:51.683394 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:51.683397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:51.683399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:51.683668 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:51.683799 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:51.684471 (+ 672us) server_negotiation.cc:299] Negotiation successful
0810 03:13:51.684699 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":216,"threads_started":1}
I20260810 03:13:51.685875 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:51.664291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34459 (local address 127.18.112.65:33483)
0810 03:13:51.665037 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:51.665081 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:51.667058 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:51.667732 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:51.667742 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:51.668432 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:51.669133 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:51.669166 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.670179 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.670184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:51.671905 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:51.671919 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:51.672641 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:51.672647 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:51.672890 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:51.677415 (+ 4525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:51.677437 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:51.679507 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:51.682274 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:51.682282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:51.682296 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:51.682695 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:51.683062 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:51.683067 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:51.683071 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:51.683270 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:51.683825 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:51.683833 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:51.684111 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 03:13:51.684340 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 03:13:51.684800 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":297,"threads_started":1}
I20260810 03:13:51.687286 2248 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34459
I20260810 03:13:51.687546 2248 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:51.688257 2248 heartbeater.cc:511] Master 127.18.112.126:34459 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:13:51.690223 1957 ts_manager.cc:194] Registered new tserver with Master: c7cdf26070ab4331aa4e3c1dd1e0dd87 (127.18.112.65:35171)
I20260810 03:13:51.691685 1957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:33483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:13:51.718701 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:52.031327 2257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:52.031590 2257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:52.031725 2257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:52.038719 2257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:52.038812 2257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:52.038973 2257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:13:52.047920 2257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:52.048995 2257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:52.050232 2257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:52.062412 2264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:52.062393 2265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:52.062472 2270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:52.063443 2257 server_base.cc:1034] running on GCE node
I20260810 03:13:52.064052 2257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:52.064865 2257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:52.066097 2257 hybrid_clock.cc:648] HybridClock initialized: now 1786331632066047 us; error 34 us; skew 500 ppm
I20260810 03:13:52.066391 2257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:52 dist-test-slave-jlzn krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331632, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:52.069324 2257 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:13:52.070677 2257 webserver.cc:460] Webserver started at http://127.18.112.66:33403/ using document root <none> and password file <none>
I20260810 03:13:52.071293 2257 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:52.071408 2257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:52.071713 2257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:52.074405 2257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "bed613dc816c2fea41c4bd9e213bfff3"
server_key_iv: "1869fb30c2691b66a35726ac5ebfc847"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.075129 2257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "bed613dc816c2fea41c4bd9e213bfff3"
server_key_iv: "1869fb30c2691b66a35726ac5ebfc847"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.079833 2257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:13:52.082912 2278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.084134 2257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:13:52.084282 2257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "bed613dc816c2fea41c4bd9e213bfff3"
server_key_iv: "1869fb30c2691b66a35726ac5ebfc847"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.084452 2257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:52.108575 2257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:52.112093 2257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:52.112350 2257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:52.113201 2257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:52.114413 2257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:52.114494 2257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.114612 2257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:52.114674 2257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.144137 2257 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:46009
I20260810 03:13:52.144184 2444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:46009 every 8 connection(s)
I20260810 03:13:52.145299 2257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:13:52.149708 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 2257
I20260810 03:13:52.149858 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:13:52.150310 18881 external_mini_cluster.cc:1428] Setting key 94fc39f6ab4605c06bee97b40b11d5d9
Aug 10 03:13:52 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331632, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:52.165026 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.147700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:45525 (local address 127.18.112.126:34459)
0810 03:13:52.147912 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.147916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.148970 (+ 1054us) server_negotiation.cc:407] Connection header received
0810 03:13:52.150858 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.150862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.150930 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.151027 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:52.152619 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.153607 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.155155 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.155736 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.155873 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.159176 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:52.159182 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:52.159186 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:52.159224 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:52.162205 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.162870 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.162874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.162876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.163005 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.163407 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.163411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.163413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.163676 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:52.163838 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.164476 (+ 638us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.164705 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:13:52.165906 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.148138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34459 (local address 127.18.112.66:45525)
0810 03:13:52.148814 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.148863 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.150583 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.151231 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.151239 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.151749 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:52.152445 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.152463 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.153752 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.153756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.155002 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.155013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.155950 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.155957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.156167 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.156773 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:52.156794 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:52.158958 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:52.162327 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:52.162334 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:52.162345 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:52.162742 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:52.163118 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:52.163121 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:52.163124 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:52.163296 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:52.163836 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:52.163843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:52.164129 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.164355 (+ 226us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.164840 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":262,"threads_started":1}
I20260810 03:13:52.167310 2446 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34459
I20260810 03:13:52.167665 2446 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:52.168524 2446 heartbeater.cc:511] Master 127.18.112.126:34459 requested a full tablet report, sending...
I20260810 03:13:52.170161 1957 ts_manager.cc:194] Registered new tserver with Master: c7ad9a548ac24c1fb2a30f0c36bd7636 (127.18.112.66:46009)
I20260810 03:13:52.171248 1957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:45525
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:13:52.210093 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:13:52.525048 2451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:13:52.525298 2451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:13:52.525394 2451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:13:52.532445 2451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:13:52.532547 2451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:13:52.532660 2451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:13:52.541643 2451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:34459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:13:52.542678 2451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:13:52.543850 2451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:13:52.556191 2457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:52.556223 2463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:13:52.556275 2459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:13:52.557220 2451 server_base.cc:1034] running on GCE node
I20260810 03:13:52.557786 2451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:13:52.558578 2451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:13:52.559779 2451 hybrid_clock.cc:648] HybridClock initialized: now 1786331632559737 us; error 30 us; skew 500 ppm
I20260810 03:13:52.560093 2451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:13:52 dist-test-slave-jlzn krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331632, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:13:52.562961 2451 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:13:52.564321 2451 webserver.cc:460] Webserver started at http://127.18.112.67:33885/ using document root <none> and password file <none>
I20260810 03:13:52.564949 2451 fs_manager.cc:359] Metadata directory not provided
I20260810 03:13:52.565064 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:13:52.565340 2451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:13:52.568168 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "76bd9574149c44fa955d133425b0ba0c"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "f4fb0011ff16c7c8bd202d3bf586ac60"
server_key_iv: "61902eefb1f4ed834668921e2e903520"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.568895 2451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "76bd9574149c44fa955d133425b0ba0c"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "f4fb0011ff16c7c8bd202d3bf586ac60"
server_key_iv: "61902eefb1f4ed834668921e2e903520"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.573621 2451 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:13:52.576906 2478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.578179 2451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:13:52.578338 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "76bd9574149c44fa955d133425b0ba0c"
format_stamp: "Formatted at 2026-08-10 03:13:52 on dist-test-slave-jlzn"
server_key: "f4fb0011ff16c7c8bd202d3bf586ac60"
server_key_iv: "61902eefb1f4ed834668921e2e903520"
server_key_version: "encryptionkey@0"
I20260810 03:13:52.578501 2451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:13:52.598923 2451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:13:52.602802 2451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:13:52.603055 2451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:13:52.603950 2451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:13:52.605206 2451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:13:52.605305 2451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.605427 2451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:13:52.605481 2451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:13:52.635620 2451 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:43661
I20260810 03:13:52.635684 2640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:43661 every 8 connection(s)
I20260810 03:13:52.636848 2451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:13:52.640293 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 2451
I20260810 03:13:52.640465 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:13:52.640944 18881 external_mini_cluster.cc:1428] Setting key ded12a3bd53cede2970a0711dfac864a
Aug 10 03:13:52 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331632, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:13:52.655431 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.639130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:58769 (local address 127.18.112.126:34459)
0810 03:13:52.639306 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.639310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.640409 (+ 1099us) server_negotiation.cc:407] Connection header received
0810 03:13:52.642379 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.642384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.642465 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.642550 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:52.644042 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.644780 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.646299 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.646706 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.646818 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.650071 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:52.650075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:52.650078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:52.650109 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:52.652529 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.653205 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.653209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.653211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.653329 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.653757 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.653760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.653762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.654037 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:52.654170 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.654852 (+ 682us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.655089 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:13:52.656298 2643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.639524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:34459 (local address 127.18.112.67:58769)
0810 03:13:52.640242 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.640287 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.642098 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.642802 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.642809 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.643285 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:13:52.643864 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.643888 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.644934 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.644938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.646152 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.646164 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.646934 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.646943 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.647162 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.647774 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:13:52.647829 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:13:52.649860 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:13:52.652664 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:52.652672 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:52.652687 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:52.653076 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:52.653441 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:13:52.653445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:13:52.653449 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:13:52.653632 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:13:52.654170 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:13:52.654178 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:13:52.654490 (+ 312us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.654715 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.655172 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":303,"threads_started":1}
I20260810 03:13:52.657444 2641 heartbeater.cc:347] Connected to a master server at 127.18.112.126:34459
I20260810 03:13:52.657691 2641 heartbeater.cc:464] Registering TS with master...
I20260810 03:13:52.658320 2641 heartbeater.cc:511] Master 127.18.112.126:34459 requested a full tablet report, sending...
I20260810 03:13:52.659605 1957 ts_manager.cc:194] Registered new tserver with Master: 76bd9574149c44fa955d133425b0ba0c (127.18.112.67:43661)
I20260810 03:13:52.660706 1957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:58769
I20260810 03:13:52.667717 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:13:52.682955 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.671951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55712 (local address 127.18.112.126:34459)
0810 03:13:52.672123 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.672129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.672557 (+ 428us) server_negotiation.cc:407] Connection header received
0810 03:13:52.672678 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.672682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.672737 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.672811 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:52.674063 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.674752 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.675967 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.676351 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.676437 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.678440 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:52.678444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:52.678448 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:52.678476 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:52.680708 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.681281 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.681284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.681286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.681408 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.681732 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.681735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.681737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.682042 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:52.682255 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.682495 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.682675 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:13:52.686305 1957 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:13:52.693006 1957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:13:52.694979 2248 heartbeater.cc:503] Master 127.18.112.126:34459 was elected leader, sending a full tablet report...
I20260810 03:13:52.715634 2657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.704668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43661 (local address 127.0.0.1:37306)
0810 03:13:52.705414 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.705463 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.705636 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.706994 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.707003 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.707037 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:52.707527 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.707546 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.709697 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.709703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.712315 (+ 2612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.712332 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.714556 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.714563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.714771 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.714821 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.714944 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.715142 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":2,"thread_start_us":339,"threads_started":1}
I20260810 03:13:52.716266 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.704687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:46009 (local address 127.0.0.1:56042)
0810 03:13:52.707422 (+ 2735us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.707438 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.707560 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.708441 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.708447 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.708473 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:52.708881 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.708892 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.710861 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.710867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.713197 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.713214 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.715349 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.715356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.715555 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.715593 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.715680 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.715828 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2621,"mutex_wait_us":2,"thread_start_us":2508,"threads_started":1}
I20260810 03:13:52.717213 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.704927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56042 (local address 127.18.112.66:46009)
0810 03:13:52.706205 (+ 1278us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.706214 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.707548 (+ 1334us) server_negotiation.cc:407] Connection header received
0810 03:13:52.707746 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.707754 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.707992 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.708174 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:52.709083 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.710694 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.713398 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.714847 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.714985 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.715176 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.716673 (+ 1497us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.716857 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1124,"thread_start_us":1009,"threads_started":1}
I20260810 03:13:52.717263 2659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.705074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37306 (local address 127.18.112.67:43661)
0810 03:13:52.706507 (+ 1433us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.706512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.706538 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:52.706610 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.706616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.706780 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.706917 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:52.707756 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.709521 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.712528 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.714021 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.714161 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.714404 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.716666 (+ 2262us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.716860 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1307,"thread_start_us":1179,"threads_started":1}
I20260810 03:13:52.721195 2543 tablet_service.cc:1467] Processing CreateTablet for tablet f54bcdf6ede543e296e59c333670e1d2 (DEFAULT_TABLE table=test-table [id=e74c5359b7b248ef82b98da6943962f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:52.722698 2543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54bcdf6ede543e296e59c333670e1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:52.724480 2348 tablet_service.cc:1467] Processing CreateTablet for tablet f54bcdf6ede543e296e59c333670e1d2 (DEFAULT_TABLE table=test-table [id=e74c5359b7b248ef82b98da6943962f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:52.725811 2348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54bcdf6ede543e296e59c333670e1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:52.727241 2657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.707583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:35171 (local address 127.0.0.1:34510)
0810 03:13:52.716401 (+ 8818us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.716418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.716507 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.720897 (+ 4390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.720902 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.720936 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:52.721150 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.721160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.722934 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.722940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.724703 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.724718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.726493 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.726499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.726691 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.726724 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.726820 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.726952 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8723,"thread_start_us":13452,"threads_started":1}
I20260810 03:13:52.727344 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.708013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.18.112.65:35171)
0810 03:13:52.720064 (+ 12051us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.720072 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.720098 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:13:52.720188 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.720195 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.720396 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.720570 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:52.721327 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.722775 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.724892 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.726314 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.726453 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.726673 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.726888 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.727039 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11896,"thread_start_us":12730,"threads_started":1}
I20260810 03:13:52.730959 2147 tablet_service.cc:1467] Processing CreateTablet for tablet f54bcdf6ede543e296e59c333670e1d2 (DEFAULT_TABLE table=test-table [id=e74c5359b7b248ef82b98da6943962f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:13:52.732347 2147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f54bcdf6ede543e296e59c333670e1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:13:52.735128 2663 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Bootstrap starting.
I20260810 03:13:52.738624 2663 tablet_bootstrap.cc:654] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:52.739698 2663 log.cc:824] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:52.739976 2664 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Bootstrap starting.
I20260810 03:13:52.743546 2664 tablet_bootstrap.cc:654] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:52.744560 2664 log.cc:824] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:52.745431 2666 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Bootstrap starting.
I20260810 03:13:52.746327 2663 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: No bootstrap required, opened a new log
I20260810 03:13:52.746582 2663 ts_tablet_manager.cc:1397] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260810 03:13:52.748356 2666 tablet_bootstrap.cc:654] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Neither blocks nor log segments found. Creating new log.
I20260810 03:13:52.748662 2664 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: No bootstrap required, opened a new log
I20260810 03:13:52.748911 2664 ts_tablet_manager.cc:1397] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.001s
I20260810 03:13:52.749327 2666 log.cc:824] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Log is configured to *not* fsync() on all Append() calls
I20260810 03:13:52.753679 2666 tablet_bootstrap.cc:492] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: No bootstrap required, opened a new log
I20260810 03:13:52.753908 2666 ts_tablet_manager.cc:1397] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 03:13:52.756964 2663 raft_consensus.cc:348] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.757367 2663 raft_consensus.cc:374] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:52.757465 2663 raft_consensus.cc:729] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76bd9574149c44fa955d133425b0ba0c, State: Initialized, Role: FOLLOWER
I20260810 03:13:52.758050 2663 consensus_queue.cc:260] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.759619 2664 raft_consensus.cc:348] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.760074 2664 raft_consensus.cc:374] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:52.760175 2664 raft_consensus.cc:729] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ad9a548ac24c1fb2a30f0c36bd7636, State: Initialized, Role: FOLLOWER
I20260810 03:13:52.760803 2664 consensus_queue.cc:260] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.761889 2446 heartbeater.cc:503] Master 127.18.112.126:34459 was elected leader, sending a full tablet report...
I20260810 03:13:52.762583 2664 ts_tablet_manager.cc:1428] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Time spent starting tablet: real 0.014s user 0.010s sys 0.002s
I20260810 03:13:52.761463 2666 raft_consensus.cc:348] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.763062 2666 raft_consensus.cc:374] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:13:52.763289 2666 raft_consensus.cc:729] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cdf26070ab4331aa4e3c1dd1e0dd87, State: Initialized, Role: FOLLOWER
I20260810 03:13:52.763948 2666 consensus_queue.cc:260] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.765693 2666 ts_tablet_manager.cc:1428] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260810 03:13:52.766446 2641 heartbeater.cc:503] Master 127.18.112.126:34459 was elected leader, sending a full tablet report...
I20260810 03:13:52.767024 2663 ts_tablet_manager.cc:1428] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Time spent starting tablet: real 0.020s user 0.014s sys 0.005s
I20260810 03:13:52.793215 2672 raft_consensus.cc:482] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:13:52.793450 2672 raft_consensus.cc:504] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.794945 2672 leader_election.cc:288] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76bd9574149c44fa955d133425b0ba0c (127.18.112.67:43661), c7ad9a548ac24c1fb2a30f0c36bd7636 (127.18.112.66:46009)
I20260810 03:13:52.801913 2659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.795554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:52265 (local address 127.18.112.67:43661)
0810 03:13:52.795739 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.795746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.796079 (+ 333us) server_negotiation.cc:407] Connection header received
0810 03:13:52.796263 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.796267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.796346 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.796442 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:52.797320 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.798160 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.800111 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.800956 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.801097 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.801170 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.801566 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.801687 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:13:52.801926 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.795361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:45517 (local address 127.18.112.66:46009)
0810 03:13:52.795755 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.795761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.796315 (+ 554us) server_negotiation.cc:407] Connection header received
0810 03:13:52.796441 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.796446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.796516 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.796607 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:13:52.797341 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.798185 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.800277 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.801031 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.801178 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.801245 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.801566 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.801695 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252}
I20260810 03:13:52.802054 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.795220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43661 (local address 127.18.112.65:52265)
0810 03:13:52.795947 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.795969 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.796130 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.796471 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.796474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.796494 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:52.797157 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.797167 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.798298 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.798304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.799941 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.799954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.801206 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.801212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.801374 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.801426 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.801503 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.801623 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":107,"thread_start_us":368,"threads_started":1}
I20260810 03:13:52.802196 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.795362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:46009 (local address 127.18.112.65:45517)
0810 03:13:52.796214 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0810 03:13:52.796234 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:13:52.796330 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:13:52.796644 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:13:52.796647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:13:52.796679 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:13:52.797152 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.797167 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.798330 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.798334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.800115 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:13:52.800130 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.801272 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.801276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:13:52.801407 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.801432 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:13:52.801523 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 03:13:52.801645 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":5,"thread_start_us":547,"threads_started":1}
I20260810 03:13:52.803030 2576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54bcdf6ede543e296e59c333670e1d2" candidate_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76bd9574149c44fa955d133425b0ba0c" is_pre_election: true
I20260810 03:13:52.803050 2379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54bcdf6ede543e296e59c333670e1d2" candidate_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" is_pre_election: true
I20260810 03:13:52.803498 2379 raft_consensus.cc:2454] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7cdf26070ab4331aa4e3c1dd1e0dd87 in term 0.
I20260810 03:13:52.803496 2576 raft_consensus.cc:2454] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7cdf26070ab4331aa4e3c1dd1e0dd87 in term 0.
I20260810 03:13:52.804132 2069 leader_election.cc:302] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 76bd9574149c44fa955d133425b0ba0c, c7ad9a548ac24c1fb2a30f0c36bd7636, c7cdf26070ab4331aa4e3c1dd1e0dd87; no voters:
I20260810 03:13:52.804492 2672 raft_consensus.cc:2781] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:13:52.804620 2672 raft_consensus.cc:482] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:13:52.804730 2672 raft_consensus.cc:3037] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:52.806851 2672 raft_consensus.cc:504] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.807377 2672 leader_election.cc:288] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [CANDIDATE]: Term 1 election: Requested vote from peers 76bd9574149c44fa955d133425b0ba0c (127.18.112.67:43661), c7ad9a548ac24c1fb2a30f0c36bd7636 (127.18.112.66:46009)
I20260810 03:13:52.807783 2576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54bcdf6ede543e296e59c333670e1d2" candidate_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76bd9574149c44fa955d133425b0ba0c"
I20260810 03:13:52.807829 2379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f54bcdf6ede543e296e59c333670e1d2" candidate_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636"
I20260810 03:13:52.807974 2576 raft_consensus.cc:3037] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:52.808000 2379 raft_consensus.cc:3037] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:13:52.810061 2576 raft_consensus.cc:2454] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7cdf26070ab4331aa4e3c1dd1e0dd87 in term 1.
I20260810 03:13:52.810123 2379 raft_consensus.cc:2454] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7cdf26070ab4331aa4e3c1dd1e0dd87 in term 1.
I20260810 03:13:52.810422 2070 leader_election.cc:302] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76bd9574149c44fa955d133425b0ba0c, c7cdf26070ab4331aa4e3c1dd1e0dd87; no voters:
I20260810 03:13:52.810708 2672 raft_consensus.cc:2781] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:13:52.811107 2672 raft_consensus.cc:686] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 1 LEADER]: Becoming Leader. State: Replica: c7cdf26070ab4331aa4e3c1dd1e0dd87, State: Running, Role: LEADER
I20260810 03:13:52.811550 2672 consensus_queue.cc:237] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } }
I20260810 03:13:52.815850 1956 catalog_manager.cc:5495] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7cdf26070ab4331aa4e3c1dd1e0dd87 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7cdf26070ab4331aa4e3c1dd1e0dd87" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 35171 } health_report { overall_health: HEALTHY } } }
I20260810 03:13:52.852201 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.846819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34512 (local address 127.18.112.65:35171)
0810 03:13:52.847020 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.847027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.847146 (+ 119us) server_negotiation.cc:407] Connection header received
0810 03:13:52.847352 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.847356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.847431 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.847554 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:13:52.847999 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.848683 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.850022 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.850442 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.850547 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.851057 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:13:52.851605 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:13:52.851739 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.851860 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.851941 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:13:52.859795 2576 raft_consensus.cc:1261] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 1 FOLLOWER]: Refusing update from remote peer c7cdf26070ab4331aa4e3c1dd1e0dd87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:52.859797 2379 raft_consensus.cc:1261] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 1 FOLLOWER]: Refusing update from remote peer c7cdf26070ab4331aa4e3c1dd1e0dd87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:13:52.860718 2681 consensus_queue.cc:1035] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76bd9574149c44fa955d133425b0ba0c" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:52.861033 2672 consensus_queue.cc:1035] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7ad9a548ac24c1fb2a30f0c36bd7636" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 46009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:13:52.887435 1956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:52.887746 1956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:13:52.891281 1956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49f6bc74955041f6ad4a11bc78503d56: Sending DeleteTablet for 3 replicas of tablet f54bcdf6ede543e296e59c333670e1d2
I20260810 03:13:52.892388 2543 tablet_service.cc:1514] Processing DeleteTablet for tablet f54bcdf6ede543e296e59c333670e1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:52 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:37306
I20260810 03:13:52.892736 2348 tablet_service.cc:1514] Processing DeleteTablet for tablet f54bcdf6ede543e296e59c333670e1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:52 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:56042
I20260810 03:13:52.893190 2694 tablet_replica.cc:330] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: stopping tablet replica
I20260810 03:13:52.893560 2695 tablet_replica.cc:330] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: stopping tablet replica
I20260810 03:13:52.893566 2694 raft_consensus.cc:2229] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:52.893913 2695 raft_consensus.cc:2229] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:13:52.893991 2694 raft_consensus.cc:2258] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:52.894322 2695 raft_consensus.cc:2258] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:52.894397 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 2042
I20260810 03:13:52.895962 2694 ts_tablet_manager.cc:1905] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:52.896198 2695 ts_tablet_manager.cc:1905] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:52.897085 2147 tablet_service.cc:1514] Processing DeleteTablet for tablet f54bcdf6ede543e296e59c333670e1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:13:52 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:34510
I20260810 03:13:52.902611 2695 ts_tablet_manager.cc:1918] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:52.902611 2694 ts_tablet_manager.cc:1918] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:52.902763 2694 log.cc:1196] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/f54bcdf6ede543e296e59c333670e1d2
I20260810 03:13:52.902794 2695 log.cc:1196] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/f54bcdf6ede543e296e59c333670e1d2
I20260810 03:13:52.903294 2694 ts_tablet_manager.cc:1939] T f54bcdf6ede543e296e59c333670e1d2 P 76bd9574149c44fa955d133425b0ba0c: Deleting consensus metadata
I20260810 03:13:52.903294 2695 ts_tablet_manager.cc:1939] T f54bcdf6ede543e296e59c333670e1d2 P c7ad9a548ac24c1fb2a30f0c36bd7636: Deleting consensus metadata
I20260810 03:13:52.904928 1934 catalog_manager.cc:4841] TS 76bd9574149c44fa955d133425b0ba0c (127.18.112.67:43661): tablet f54bcdf6ede543e296e59c333670e1d2 (table test-table [id=e74c5359b7b248ef82b98da6943962f0]) successfully deleted
I20260810 03:13:52.904990 1933 catalog_manager.cc:4841] TS c7ad9a548ac24c1fb2a30f0c36bd7636 (127.18.112.66:46009): tablet f54bcdf6ede543e296e59c333670e1d2 (table test-table [id=e74c5359b7b248ef82b98da6943962f0]) successfully deleted
I20260810 03:13:52.908370 2698 tablet_replica.cc:330] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: stopping tablet replica
I20260810 03:13:52.908713 2698 raft_consensus.cc:2229] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:13:52.909380 2698 raft_consensus.cc:2258] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:13:52.911031 2698 ts_tablet_manager.cc:1905] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:13:52.917667 2698 ts_tablet_manager.cc:1918] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:13:52.917804 2698 log.cc:1196] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/f54bcdf6ede543e296e59c333670e1d2
Aug 10 03:13:52 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:13:52.918267 2698 ts_tablet_manager.cc:1939] T f54bcdf6ede543e296e59c333670e1d2 P c7cdf26070ab4331aa4e3c1dd1e0dd87: Deleting consensus metadata
I20260810 03:13:52.919718 1933 catalog_manager.cc:4841] TS c7cdf26070ab4331aa4e3c1dd1e0dd87 (127.18.112.65:35171): tablet f54bcdf6ede543e296e59c333670e1d2 (table test-table [id=e74c5359b7b248ef82b98da6943962f0]) successfully deleted
I20260810 03:13:52.924752 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:52.896457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34518 (local address 127.18.112.65:35171)
0810 03:13:52.896841 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:52.896847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:52.908328 (+ 11481us) server_negotiation.cc:407] Connection header received
0810 03:13:52.908533 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:52.908539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:52.908638 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:52.908757 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:52.910311 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.911428 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.913215 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:52.913941 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:52.914066 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:52.918961 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:52.918972 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:52.918988 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:52.919035 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:52.922034 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.922807 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.922814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.922816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.922964 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:52.923375 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:52.923378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:52.923380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:52.923720 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:52.923966 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:52.924309 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 03:13:52.924476 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253}
I20260810 03:13:52.925333 2239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:53.020706 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 2042
I20260810 03:13:53.044445 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 2257
Aug 10 03:13:53 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:13:53.058426 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:53.045215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56054 (local address 127.18.112.66:46009)
0810 03:13:53.045418 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:53.045423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:53.045443 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:13:53.045507 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:53.045512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:53.045583 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:53.045675 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:53.046947 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:53.047727 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:53.048981 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:53.049377 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:53.049488 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:53.053460 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:53.053473 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:53.053489 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:53.053535 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:53.056262 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:53.056849 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:53.056856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:53.056858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:53.056978 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:53.057248 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:53.057251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:53.057253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:53.057606 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:53.057824 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:53.058027 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 03:13:53.058182 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 03:13:53.059154 2436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:53.144361 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 2257
I20260810 03:13:53.165319 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 2451
Aug 10 03:13:53 dist-test-slave-jlzn krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:13:53.180047 2659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:13:53.166083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37314 (local address 127.18.112.67:43661)
0810 03:13:53.166291 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 03:13:53.166297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:13:53.166316 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:13:53.166449 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:13:53.166454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:13:53.166534 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:13:53.166624 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:13:53.168044 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:53.168768 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:53.170014 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:13:53.170408 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:13:53.170519 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:13:53.174637 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:13:53.174652 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:13:53.174667 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:13:53.174699 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:13:53.177372 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:53.178024 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:53.178031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:53.178033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:53.178170 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:13:53.178543 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:13:53.178547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:13:53.178549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:13:53.178906 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:13:53.179190 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0810 03:13:53.179526 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 03:13:53.179737 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 03:13:53.180656 2633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:53.266621 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 2451
I20260810 03:13:53.284942 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 1905
I20260810 03:13:53.286043 2003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:13:53.394641 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 1905
2026-08-10T03:13:53Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4139 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:13:53 dist-test-slave-jlzn krb5kdc[2708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:13:53 dist-test-slave-jlzn krb5kdc[2708](info): set up 2 sockets
Aug 10 03:13:53 dist-test-slave-jlzn krb5kdc[2708](info): commencing operation
krb5kdc: starting...
W20260810 03:13:54.589074 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:13:54 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:13:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:13:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangeradmin_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangeradmin_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangerlookup_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangerlookup_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
I20260810 03:13:54.912256 18881 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJGLf1q/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/postgres -l logfile start
2026-08-10 03:13:57.211 UTC [2751] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 03:13:57.211 UTC [2751] LOG: listening on IPv4 address "127.18.112.84", port 33557
2026-08-10 03:13:57.214 UTC [2751] LOG: listening on Unix socket "/tmp/.s.PGSQL.33557"
2026-08-10 03:13:57.233 UTC [2755] LOG: database system was shut down at 2026-08-10 03:13:55 UTC
2026-08-10 03:13:57.237 UTC [2751] LOG: database system is ready to accept connections
I20260810 03:13:58.558274 18881 mini_postgres.cc:96] Postgres bound to 33557
2026-08-10 03:13:58.593 UTC [2767] FATAL: database "slave" does not exist
127.18.112.84:33557 - accepting connections
I20260810 03:13:58.594801 18881 mini_ranger.cc:161] Starting Ranger...
I20260810 03:13:58.639374 18881 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 03:13:59.167372 18881 mini_ranger.cc:87] Created ranger Postgres database
I20260810 03:13:59.167655 18881 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin
2026-08-10 03:13:59,654 [I] DB FLAVOR :POSTGRES
2026-08-10 03:13:59,655 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:13:59,655 [I] Checking connection..
2026-08-10 03:13:59,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 03:14:00,048 [I] Checking connection passed.
2026-08-10 03:14:00,048 [I] --------- Verifying version history table ---------
2026-08-10 03:14:00,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:00,302 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:14:00,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:00,555 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:14:00,555 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 03:14:00,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 03:14:00.785 UTC [2862] WARNING: there is no transaction in progress
2026-08-10 03:14:00,793 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 03:14:00,793 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:01,031 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 03:14:01,031 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:14:01,032 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 03:14:01,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 03:14:01,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-10 03:14:01,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:14:02,015 [I] Table x_portal_user does not exist in database ranger
2026-08-10 03:14:02,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:14:02,269 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 03:14:02,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:14:02,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:14:02,764 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 03:14:02,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 03:14:03.629 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.644 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.658 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.671 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.684 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.699 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.748 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.755 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.768 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.777 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.786 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.798 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.807 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.813 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.819 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:03.825 UTC [3031] WARNING: there is no transaction in progress
2026-08-10 03:14:04,373 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 03:14:04,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 03:14:04,590 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 03:14:04,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:14:04,831 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 03:14:04,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:14:05,085 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 03:14:05,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:14:05,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:14:05,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-10 03:14:05,801 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 03:14:05,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 03:14:06,052 [I] DB_PATCHES have already been applied
I20260810 03:14:06.057842 18881 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJGLf1q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 03:14:06.057957 18881 mini_ranger.cc:193] Using host: 127.18.112.84
I20260810 03:14:06.076936 18881 mini_ranger.cc:227] Ranger admin URL: http://127.18.112.84:43231
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:14:06 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 03:14:07.294463 18881 mini_ranger.cc:160] Time spent starting Ranger: real 8.700s user 0.003s sys 0.066s
Aug 10, 2026 3:14:26 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:14:26 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 10, 2026 3:14:26 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:14:26 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:14:27 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 03:14:28.135298 18881 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangerkms_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/rangerkms_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.112.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.112.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 03:14:28 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 03:14:28.302609 18881 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 03:14:28.324798 18881 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 03:14:29.013931 18881 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 03:14:29.014073 18881 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms
I20260810 03:14:29.014227 18881 mini_ranger_kms.cc:227] Using postgres at 127.18.112.84:33557
2026-08-10 03:14:29,443 [I] DB FLAVOR :POSTGRES
2026-08-10 03:14:29,443 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:14:29,444 [I] Checking connection
2026-08-10 03:14:29,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 03:14:29,692 [I] connection success
2026-08-10 03:14:29,692 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 03:14:29,692 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 03:14:29,692 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 03:14:29,924 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 03:14:29,925 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:14:29,925 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 03:14:29,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:33557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 03:14:30,184 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 03:14:30.638654 18881 mini_ranger_kms.cc:310] Created kms service
I20260810 03:14:30.814599 18881 mini_ranger_kms.cc:326] Created kudu user
I20260810 03:14:30.859153 18881 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 03:14:30 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:31.276717 18881 mini_ranger_kms.cc:384] Added ranger policy
I20260810 03:14:31.277043 18881 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 03:14:31.277115 18881 mini_ranger_kms.cc:240] Using host: 127.18.112.84
I20260810 03:14:31.306293 18881 mini_ranger_kms.cc:276] Ranger KMS PID: 3306
I20260810 03:14:31.306448 18881 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.112.84:49663
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:14:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 03:14:33 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786331673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:14:33.790230 18881 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.488s user 0.115s sys 0.350s
I20260810 03:14:33.790462 18881 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 03:14:33.790652 18881 mini_ranger_kms.cc:401] 127.18.112.84:49663/kms/v1/keys
Aug 10 03:14:34 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:14:34 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:14:36 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:14:36.599043 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40425
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:40425
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:49663/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:14:37.047027 3381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:14:37.047298 3381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:14:37.047387 3381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:14:37.054593 3381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:14:37.054699 3381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:14:37.054744 3381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:14:37.054816 3381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:14:37.054888 3381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:14:37.065263 3381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.112.84:49663/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:40425
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:14:37.066485 3381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:14:37.067782 3381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:14:37.081777 3390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:14:37.082053 3381 server_base.cc:1034] running on GCE node
W20260810 03:14:37.081758 3392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:37.082177 3389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:14:37.083191 3381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:14:37.084635 3381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:14:37.085845 3381 hybrid_clock.cc:648] HybridClock initialized: now 1786331677085779 us; error 56 us; skew 500 ppm
I20260810 03:14:37.086176 3381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:14:37 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331677, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:14:37.092208 3381 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:14:37.093637 3381 webserver.cc:460] Webserver started at http://127.18.112.126:42673/ using document root <none> and password file <none>
I20260810 03:14:37.094240 3381 fs_manager.cc:359] Metadata directory not provided
I20260810 03:14:37.094352 3381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:14:37.094655 3381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:14:37 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331677, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:37.150597 3381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "82becf3d75d742d4960b3de34a0e3618"
format_stamp: "Formatted at 2026-08-10 03:14:37 on dist-test-slave-jlzn"
server_key: "cea73ec8d3f9185ec3493d2d50b29f8d"
server_key_iv: "4add290d4cf85066c26c47cead9421f3"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:37.151461 3381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "82becf3d75d742d4960b3de34a0e3618"
format_stamp: "Formatted at 2026-08-10 03:14:37 on dist-test-slave-jlzn"
server_key: "cea73ec8d3f9185ec3493d2d50b29f8d"
server_key_iv: "4add290d4cf85066c26c47cead9421f3"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:37.157104 3381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 03:14:37.174378 3405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:37.175746 3381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:14:37.175935 3381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "82becf3d75d742d4960b3de34a0e3618"
format_stamp: "Formatted at 2026-08-10 03:14:37 on dist-test-slave-jlzn"
server_key: "cea73ec8d3f9185ec3493d2d50b29f8d"
server_key_iv: "4add290d4cf85066c26c47cead9421f3"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:37.176141 3381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:14:37.193073 3381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:14:37.196521 3381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:14:37.196791 3381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:14:37.231892 3381 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:40425
I20260810 03:14:37.231927 3484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:40425 every 8 connection(s)
I20260810 03:14:37.233764 3381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:14:37.238517 3485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:14:37.240854 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 3381
I20260810 03:14:37.241079 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:14:37.242103 18881 external_mini_cluster.cc:1428] Setting key e48d14e2f9d33274e96317077a98b5a7
I20260810 03:14:37.256825 3485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: Bootstrap starting.
Aug 10 03:14:37 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:14:37.262077 3485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: Neither blocks nor log segments found. Creating new log.
I20260810 03:14:37.264284 3485 log.cc:824] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: Log is configured to *not* fsync() on all Append() calls
I20260810 03:14:37.269147 3485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: No bootstrap required, opened a new log
I20260810 03:14:37.270568 3491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:37.244449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56110 (local address 127.18.112.126:40425)
0810 03:14:37.245680 (+ 1231us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:37.245690 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:37.245756 (+ 66us) server_negotiation.cc:407] Connection header received
0810 03:14:37.248483 (+ 2727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:37.248509 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:37.248856 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:37.249207 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:37.250747 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:37.252339 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:37.254132 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:37.255154 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:37.255315 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:37.260083 (+ 4768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:37.260095 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:37.260112 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:37.260191 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:37.265882 (+ 5691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:37.266712 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:37.266719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:37.266725 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:37.267030 (+ 305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:37.267388 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:37.267393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:37.267397 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:37.268114 (+ 717us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:37.268450 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:37.268711 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 03:14:37.269104 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":951,"thread_start_us":712,"threads_started":1}
I20260810 03:14:37.280856 3485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } }
I20260810 03:14:37.281385 3485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:14:37.281538 3485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82becf3d75d742d4960b3de34a0e3618, State: Initialized, Role: FOLLOWER
I20260810 03:14:37.282189 3485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } }
I20260810 03:14:37.282586 3485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:14:37.282881 3485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:14:37.283166 3485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:14:37.286316 3485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } }
I20260810 03:14:37.286924 3485 leader_election.cc:302] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82becf3d75d742d4960b3de34a0e3618; no voters:
I20260810 03:14:37.288004 3485 leader_election.cc:288] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:14:37.288148 3493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:14:37.289628 3493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [term 1 LEADER]: Becoming Leader. State: Replica: 82becf3d75d742d4960b3de34a0e3618, State: Running, Role: LEADER
I20260810 03:14:37.290434 3493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } }
I20260810 03:14:37.291271 3485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:14:37.294891 3495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82becf3d75d742d4960b3de34a0e3618. Latest consensus state: current_term: 1 leader_uuid: "82becf3d75d742d4960b3de34a0e3618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } } }
I20260810 03:14:37.295763 3495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [sys.catalog]: This master's current role is: LEADER
I20260810 03:14:37.294946 3494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82becf3d75d742d4960b3de34a0e3618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82becf3d75d742d4960b3de34a0e3618" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40425 } } }
I20260810 03:14:37.296214 3494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618 [sys.catalog]: This master's current role is: LEADER
I20260810 03:14:37.298161 3503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:14:37.305451 3503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:14:37.316123 3485 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 03:14:37.332322 3503 catalog_manager.cc:1347] Generated new cluster ID: 0e07003719a4477d847b68f63366e54f
I20260810 03:14:37.332549 3503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:14:37.351438 3503 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:14:37.353760 3503 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:14:37.370999 3503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: Generated new TSK 0
I20260810 03:14:37.372258 3503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:14:38.175730 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:49663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:14:38 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 03:14:38.793238 3550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:14:38.793625 3550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:14:38.793820 3550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:14:38.804433 3550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:14:38.804665 3550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:14:38.804917 3550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:14:38.819057 3550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.112.84:49663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:14:38.820878 3550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:14:38.822846 3550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:14:38.846598 3565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:38.846824 3566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:38.853348 3569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:14:38.860795 3550 server_base.cc:1034] running on GCE node
I20260810 03:14:38.861655 3550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:14:38.874948 3550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:14:38.878350 3550 hybrid_clock.cc:648] HybridClock initialized: now 1786331678878262 us; error 75 us; skew 500 ppm
I20260810 03:14:38.879321 3550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:14:38 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:14:38.884855 3550 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:14:38.893690 3550 webserver.cc:460] Webserver started at http://127.18.112.65:44861/ using document root <none> and password file <none>
I20260810 03:14:38.894799 3550 fs_manager.cc:359] Metadata directory not provided
I20260810 03:14:38.894951 3550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:14:38.895411 3550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:14:38 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:38.926760 3550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "ecbb74e12a5e4e4aa28362d6f3913198"
format_stamp: "Formatted at 2026-08-10 03:14:38 on dist-test-slave-jlzn"
server_key: "5655a74b45b7cdfa1444bbfe3b6a7330"
server_key_iv: "edbd60cd084e177cd19ed50251d1a071"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:38.928349 3550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "ecbb74e12a5e4e4aa28362d6f3913198"
format_stamp: "Formatted at 2026-08-10 03:14:38 on dist-test-slave-jlzn"
server_key: "5655a74b45b7cdfa1444bbfe3b6a7330"
server_key_iv: "edbd60cd084e177cd19ed50251d1a071"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:38.943277 3550 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.008s sys 0.004s
I20260810 03:14:38.975328 3579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:38.977629 3550 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.006s
I20260810 03:14:38.977838 3550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "ecbb74e12a5e4e4aa28362d6f3913198"
format_stamp: "Formatted at 2026-08-10 03:14:38 on dist-test-slave-jlzn"
server_key: "5655a74b45b7cdfa1444bbfe3b6a7330"
server_key_iv: "edbd60cd084e177cd19ed50251d1a071"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:38.978113 3550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:14:39.012135 3550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:14:39.019549 3550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:14:39.020038 3550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:14:39.022312 3550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 10 03:14:39 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:39.025074 3550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:14:39.025344 3550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:39.025756 3550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:14:39.025964 3550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:39.248466 3550 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:40789
I20260810 03:14:39.248533 3746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:40789 every 8 connection(s)
I20260810 03:14:39.250146 3550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:14:39.259382 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 3550
I20260810 03:14:39.259599 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:14:39.260902 18881 external_mini_cluster.cc:1428] Setting key 7c7f8d616f9de7d03e6e91d41140591a
Aug 10 03:14:39 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
I20260810 03:14:39.303690 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:39.256303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:57953 (local address 127.18.112.126:40425)
0810 03:14:39.280742 (+ 24439us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:39.280749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:39.280769 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:14:39.280825 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:39.280830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:39.280902 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:39.281001 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:39.283699 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:39.285101 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:39.288429 (+ 3328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:39.289101 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:39.289191 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:39.294385 (+ 5194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:39.294391 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:39.294395 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:39.294433 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:39.298653 (+ 4220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:39.299791 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:39.299797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:39.299820 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:39.300097 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:39.300918 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:39.300923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:39.300926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:39.301330 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:39.301459 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:39.302591 (+ 1132us) server_negotiation.cc:299] Negotiation successful
0810 03:14:39.302815 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24282,"thread_start_us":23939,"threads_started":1}
I20260810 03:14:39.304581 3752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:39.257277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40425 (local address 127.18.112.65:57953)
0810 03:14:39.271430 (+ 14153us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:39.271509 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:39.275149 (+ 3640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:39.281609 (+ 6460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:39.281622 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:39.282456 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:14:39.283469 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:39.283497 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:39.285347 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:39.285351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:39.288261 (+ 2910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:39.288285 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:39.289701 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:39.289713 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:39.290200 (+ 487us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:39.291196 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:14:39.291224 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:14:39.294151 (+ 2927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:14:39.298847 (+ 4696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:39.298856 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:39.298875 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:39.299653 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:39.300256 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:39.300260 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:39.300264 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:39.300777 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:39.301635 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:14:39.301643 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:14:39.302109 (+ 466us) client_negotiation.cc:769] Sending connection context
0810 03:14:39.302468 (+ 359us) client_negotiation.cc:240] Negotiation successful
0810 03:14:39.302991 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13791,"thread_start_us":18196,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
I20260810 03:14:39.306588 3749 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40425
I20260810 03:14:39.306913 3749 heartbeater.cc:464] Registering TS with master...
I20260810 03:14:39.307950 3749 heartbeater.cc:511] Master 127.18.112.126:40425 requested a full tablet report, sending...
I20260810 03:14:39.314029 3430 ts_manager.cc:194] Registered new tserver with Master: ecbb74e12a5e4e4aa28362d6f3913198 (127.18.112.65:40789)
I20260810 03:14:39.315970 3430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:57953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:14:39.347368 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:49663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:14:39 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
W20260810 03:14:39.927238 3756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:14:39.927517 3756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:14:39.927635 3756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:14:39.934975 3756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:14:39.935086 3756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:14:39.935241 3756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:14:39.945537 3756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.112.84:49663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:14:39.946844 3756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:14:39.948205 3756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:14:39.963748 3775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:39.964035 3774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:39.964236 3777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:14:39.964596 3756 server_base.cc:1034] running on GCE node
I20260810 03:14:39.965291 3756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:14:39.966235 3756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:14:39.967451 3756 hybrid_clock.cc:648] HybridClock initialized: now 1786331679967397 us; error 47 us; skew 500 ppm
I20260810 03:14:39.967743 3756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:14:39 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:14:39.971158 3756 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:14:39.973031 3756 webserver.cc:460] Webserver started at http://127.18.112.66:44029/ using document root <none> and password file <none>
I20260810 03:14:39.973706 3756 fs_manager.cc:359] Metadata directory not provided
I20260810 03:14:39.973860 3756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:14:39.974159 3756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:14:39 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:39.991374 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "a8b9d47b6bf041769c088eee0fd81c58"
format_stamp: "Formatted at 2026-08-10 03:14:39 on dist-test-slave-jlzn"
server_key: "5bcce9d3441017128f681ce112f3449b"
server_key_iv: "8a0ac8d232eca8a9073b42da7118c162"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:39.992363 3756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "a8b9d47b6bf041769c088eee0fd81c58"
format_stamp: "Formatted at 2026-08-10 03:14:39 on dist-test-slave-jlzn"
server_key: "5bcce9d3441017128f681ce112f3449b"
server_key_iv: "8a0ac8d232eca8a9073b42da7118c162"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:39.997951 3756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:14:40.020414 3785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.021903 3756 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.006s sys 0.003s
I20260810 03:14:40.022068 3756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "a8b9d47b6bf041769c088eee0fd81c58"
format_stamp: "Formatted at 2026-08-10 03:14:39 on dist-test-slave-jlzn"
server_key: "5bcce9d3441017128f681ce112f3449b"
server_key_iv: "8a0ac8d232eca8a9073b42da7118c162"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:40.022269 3756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:14:40.065636 3756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:14:40.069552 3756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:14:40.069835 3756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:14:40.070798 3756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:14:40.072605 3756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:14:40.072683 3756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.072804 3756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:14:40.072857 3756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.120677 3756 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:34531
I20260810 03:14:40.120791 3963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:34531 every 8 connection(s)
I20260810 03:14:40.122078 3756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:14:40.128525 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 3756
I20260810 03:14:40.128713 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:14:40.129135 18881 external_mini_cluster.cc:1428] Setting key 71e6c3f96e3a3d38a54236cb38d96eb1
Aug 10 03:14:40 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:14:40.142921 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.124630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:46467 (local address 127.18.112.126:40425)
0810 03:14:40.125165 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.125172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.126163 (+ 991us) server_negotiation.cc:407] Connection header received
0810 03:14:40.128182 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.128187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.128275 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.128407 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:40.129816 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.130625 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.132311 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.132732 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.132856 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.136690 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:40.136695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:40.136698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:40.136734 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:40.139956 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.140657 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.140661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.140663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.140786 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.141202 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.141205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.141207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.141474 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:40.141616 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.142345 (+ 729us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.142557 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":248,"threads_started":1}
I20260810 03:14:40.143918 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.125248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40425 (local address 127.18.112.66:46467)
0810 03:14:40.125988 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.126043 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.127874 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.128571 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.128579 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.129045 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:14:40.129652 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.129669 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.130771 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.130774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.132100 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.132182 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.133046 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.133054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.133398 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.134181 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:14:40.134206 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:14:40.136451 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:14:40.140095 (+ 3644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:40.140104 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:40.140119 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:40.140534 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:40.140890 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:40.140895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:40.140899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:40.141086 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:40.141601 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:14:40.141608 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:14:40.141977 (+ 369us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.142208 (+ 231us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.142703 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":306,"threads_started":1}
I20260810 03:14:40.145347 3965 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40425
I20260810 03:14:40.145620 3965 heartbeater.cc:464] Registering TS with master...
I20260810 03:14:40.146309 3965 heartbeater.cc:511] Master 127.18.112.126:40425 requested a full tablet report, sending...
I20260810 03:14:40.147960 3430 ts_manager.cc:194] Registered new tserver with Master: a8b9d47b6bf041769c088eee0fd81c58 (127.18.112.66:34531)
I20260810 03:14:40.148730 3430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:46467
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:14:40.194809 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:49663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:14:40.319586 3749 heartbeater.cc:503] Master 127.18.112.126:40425 was elected leader, sending a full tablet report...
W20260810 03:14:40.598446 3975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:14:40.598706 3975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:14:40.598802 3975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:14:40.606690 3975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:14:40.606791 3975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:14:40.606905 3975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:14:40.617082 3975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.112.84:49663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40425
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:14:40.618171 3975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:14:40.619510 3975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:14:40.632884 3982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:40.632841 3983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:14:40.633503 3988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:14:40.633823 3975 server_base.cc:1034] running on GCE node
I20260810 03:14:40.634450 3975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:14:40.635540 3975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:14:40.636793 3975 hybrid_clock.cc:648] HybridClock initialized: now 1786331680636703 us; error 27 us; skew 500 ppm
I20260810 03:14:40.637154 3975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:14:40 dist-test-slave-jlzn krb5kdc[2708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331680, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:14:40.640254 3975 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:14:40.641577 3975 webserver.cc:460] Webserver started at http://127.18.112.67:37905/ using document root <none> and password file <none>
I20260810 03:14:40.642177 3975 fs_manager.cc:359] Metadata directory not provided
I20260810 03:14:40.642293 3975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:14:40.642577 3975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:14:40 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331680, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:14:40.657819 3975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "cb8c0fa753834b528e8a817ea7c24182"
format_stamp: "Formatted at 2026-08-10 03:14:40 on dist-test-slave-jlzn"
server_key: "174a839091c25c6467aeb8a0938d77fa"
server_key_iv: "101bc0d75eb5e284a049c34f03d01d47"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:40.658828 3975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "cb8c0fa753834b528e8a817ea7c24182"
format_stamp: "Formatted at 2026-08-10 03:14:40 on dist-test-slave-jlzn"
server_key: "174a839091c25c6467aeb8a0938d77fa"
server_key_iv: "101bc0d75eb5e284a049c34f03d01d47"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:40.664273 3975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 03:14:40.679083 3996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.680514 3975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:14:40.680662 3975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "cb8c0fa753834b528e8a817ea7c24182"
format_stamp: "Formatted at 2026-08-10 03:14:40 on dist-test-slave-jlzn"
server_key: "174a839091c25c6467aeb8a0938d77fa"
server_key_iv: "101bc0d75eb5e284a049c34f03d01d47"
server_key_version: "kuduclusterkey@0"
I20260810 03:14:40.680842 3975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:14:40.697707 3975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:14:40.701074 3975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:14:40.701325 3975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:14:40.702548 3975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:14:40.704042 3975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:14:40.704118 3975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.704226 3975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:14:40.704288 3975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:14:40.740780 3975 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:43347
I20260810 03:14:40.740828 4166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:43347 every 8 connection(s)
I20260810 03:14:40.741971 3975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:14:40.750628 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 3975
I20260810 03:14:40.750816 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:14:40.751346 18881 external_mini_cluster.cc:1428] Setting key 3d60a9babbe8764e4d84928ab9a75dd0
Aug 10 03:14:40 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331680, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:14:40.760538 4170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.744259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:47939 (local address 127.18.112.126:40425)
0810 03:14:40.744699 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.744704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.745606 (+ 902us) server_negotiation.cc:407] Connection header received
0810 03:14:40.747308 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.747314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.747404 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.747498 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:40.748930 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.749656 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.751645 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.752261 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.752390 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.755490 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:40.755495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:40.755498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:40.755531 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:40.758055 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.758719 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.758723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.758725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.758848 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.759178 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.759180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.759182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.759423 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:40.759537 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.760124 (+ 587us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.760290 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":215,"threads_started":1}
I20260810 03:14:40.761379 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.744804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40425 (local address 127.18.112.67:47939)
0810 03:14:40.745468 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.745505 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.747057 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.747740 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.747748 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.748181 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:14:40.748770 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.748789 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.749805 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.749809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.751476 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.751517 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.752477 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.752485 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.752752 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.753308 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:14:40.753330 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:14:40.755311 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:14:40.758191 (+ 2880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:40.758197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:40.758207 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:40.758620 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:40.758928 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:14:40.758931 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:14:40.758933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:14:40.759103 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:14:40.759518 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:14:40.759523 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:14:40.759779 (+ 256us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.760048 (+ 269us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.760381 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":276,"threads_started":1}
I20260810 03:14:40.762560 4167 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40425
I20260810 03:14:40.762821 4167 heartbeater.cc:464] Registering TS with master...
I20260810 03:14:40.763477 4167 heartbeater.cc:511] Master 127.18.112.126:40425 requested a full tablet report, sending...
I20260810 03:14:40.764907 3430 ts_manager.cc:194] Registered new tserver with Master: cb8c0fa753834b528e8a817ea7c24182 (127.18.112.67:43347)
I20260810 03:14:40.765829 3430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:47939
I20260810 03:14:40.766572 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:14:40.782598 4170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.771248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.18.112.126:40425)
0810 03:14:40.771379 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.771383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.772074 (+ 691us) server_negotiation.cc:407] Connection header received
0810 03:14:40.772196 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.772199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.772264 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.772336 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:40.773576 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.774263 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.775535 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.776017 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.776105 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.778234 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:40.778238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:40.778241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:40.778267 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:40.780603 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.781197 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.781201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.781203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.781323 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:40.781594 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:40.781597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:40.781599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:40.781818 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:40.781984 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.782231 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.782383 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:14:40.786561 3429 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:14:40.794157 3429 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:14:40.816896 4190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.806048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40789 (local address 127.0.0.1:47206)
0810 03:14:40.806885 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.806929 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.807098 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.808227 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.808234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.808263 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:14:40.808748 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.808763 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.810855 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.810860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.813795 (+ 2935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.813815 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.815777 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.815782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.815972 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.816023 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.816175 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.816365 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":25,"thread_start_us":3800,"threads_started":1}
I20260810 03:14:40.818015 4196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.806244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47206 (local address 127.18.112.65:40789)
0810 03:14:40.807613 (+ 1369us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.807621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.807650 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:14:40.807745 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.807752 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.808006 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.808186 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:14:40.809157 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.810735 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.814023 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.815576 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.815740 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.816094 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.816221 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.817679 (+ 1458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1196,"thread_start_us":2095,"threads_started":1}
I20260810 03:14:40.818063 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.806109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34531 (local address 127.0.0.1:44018)
0810 03:14:40.809456 (+ 3347us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.809479 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.809596 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.810237 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.810246 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.810272 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:14:40.810689 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.810701 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.812972 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.812978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.815203 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.815220 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.817258 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.817265 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.817450 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.817482 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.817546 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.817665 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2711,"mutex_wait_us":1,"thread_start_us":428,"threads_started":1}
I20260810 03:14:40.819092 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.807234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.18.112.66:34531)
0810 03:14:40.807871 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.807879 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.809710 (+ 1831us) server_negotiation.cc:407] Connection header received
0810 03:14:40.809820 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.809827 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.810030 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.810934 (+ 904us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:14:40.811127 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.812772 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.815426 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.816990 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.818056 (+ 1066us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.818244 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.818307 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.818454 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":909,"threads_started":1}
I20260810 03:14:40.820712 4202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.807914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47890 (local address 127.18.112.67:43347)
0810 03:14:40.809326 (+ 1412us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.809334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.810609 (+ 1275us) server_negotiation.cc:407] Connection header received
0810 03:14:40.810787 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.810795 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.811049 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.811267 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:14:40.812169 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.813819 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.818016 (+ 4197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.819550 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.819687 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.819924 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.820188 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.820351 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1249,"thread_start_us":1086,"threads_started":1}
I20260810 03:14:40.821571 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.806857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:43347 (local address 127.0.0.1:47890)
0810 03:14:40.810262 (+ 3405us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.810279 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.810447 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.811297 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.811302 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.811330 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:14:40.811896 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.811911 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.816018 (+ 4107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.816023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.817855 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.817867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.819785 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.819793 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.819984 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.820023 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.820107 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.820224 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3234,"thread_start_us":1681,"threads_started":1}
I20260810 03:14:40.821847 3647 tablet_service.cc:1467] Processing CreateTablet for tablet 016ee55217444d59919a5fca910f2115 (DEFAULT_TABLE table=test-table [id=e8d1462cd2d94b61842e65f24da4fedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:14:40.822868 3868 tablet_service.cc:1467] Processing CreateTablet for tablet 016ee55217444d59919a5fca910f2115 (DEFAULT_TABLE table=test-table [id=e8d1462cd2d94b61842e65f24da4fedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:14:40.823326 3647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016ee55217444d59919a5fca910f2115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:14:40.823945 3868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016ee55217444d59919a5fca910f2115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:14:40.825234 4070 tablet_service.cc:1467] Processing CreateTablet for tablet 016ee55217444d59919a5fca910f2115 (DEFAULT_TABLE table=test-table [id=e8d1462cd2d94b61842e65f24da4fedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:14:40.827458 4070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016ee55217444d59919a5fca910f2115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:14:40.837227 4203 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Bootstrap starting.
I20260810 03:14:40.839152 4204 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Bootstrap starting.
I20260810 03:14:40.841184 4203 tablet_bootstrap.cc:654] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Neither blocks nor log segments found. Creating new log.
I20260810 03:14:40.842255 4205 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Bootstrap starting.
I20260810 03:14:40.842785 4204 tablet_bootstrap.cc:654] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Neither blocks nor log segments found. Creating new log.
I20260810 03:14:40.843525 4203 log.cc:824] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Log is configured to *not* fsync() on all Append() calls
I20260810 03:14:40.844156 4204 log.cc:824] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Log is configured to *not* fsync() on all Append() calls
I20260810 03:14:40.845889 4205 tablet_bootstrap.cc:654] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Neither blocks nor log segments found. Creating new log.
I20260810 03:14:40.847172 4205 log.cc:824] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Log is configured to *not* fsync() on all Append() calls
I20260810 03:14:40.847527 4204 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: No bootstrap required, opened a new log
I20260810 03:14:40.847926 4204 ts_tablet_manager.cc:1397] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 03:14:40.848163 4203 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: No bootstrap required, opened a new log
I20260810 03:14:40.848582 4203 ts_tablet_manager.cc:1397] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260810 03:14:40.851023 4205 tablet_bootstrap.cc:492] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: No bootstrap required, opened a new log
I20260810 03:14:40.851418 4205 ts_tablet_manager.cc:1397] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 03:14:40.858340 4203 raft_consensus.cc:348] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.858712 4203 raft_consensus.cc:374] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:14:40.858817 4203 raft_consensus.cc:729] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecbb74e12a5e4e4aa28362d6f3913198, State: Initialized, Role: FOLLOWER
I20260810 03:14:40.859421 4203 consensus_queue.cc:260] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.862221 4203 ts_tablet_manager.cc:1428] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260810 03:14:40.862270 4204 raft_consensus.cc:348] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.862957 4204 raft_consensus.cc:374] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:14:40.863168 4204 raft_consensus.cc:729] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b9d47b6bf041769c088eee0fd81c58, State: Initialized, Role: FOLLOWER
I20260810 03:14:40.864146 4204 consensus_queue.cc:260] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.864686 4205 raft_consensus.cc:348] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.865125 4205 raft_consensus.cc:374] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:14:40.865237 4205 raft_consensus.cc:729] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb8c0fa753834b528e8a817ea7c24182, State: Initialized, Role: FOLLOWER
I20260810 03:14:40.865904 4205 consensus_queue.cc:260] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.867777 4167 heartbeater.cc:503] Master 127.18.112.126:40425 was elected leader, sending a full tablet report...
I20260810 03:14:40.868558 4205 ts_tablet_manager.cc:1428] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Time spent starting tablet: real 0.017s user 0.010s sys 0.009s
I20260810 03:14:40.870285 3965 heartbeater.cc:503] Master 127.18.112.126:40425 was elected leader, sending a full tablet report...
I20260810 03:14:40.871080 4204 ts_tablet_manager.cc:1428] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Time spent starting tablet: real 0.023s user 0.010s sys 0.010s
W20260810 03:14:40.874191 3966 tablet.cc:2369] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:14:40.926525 4218 raft_consensus.cc:482] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:14:40.927009 4218 raft_consensus.cc:504] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.929608 4218 leader_election.cc:288] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecbb74e12a5e4e4aa28362d6f3913198 (127.18.112.65:40789), a8b9d47b6bf041769c088eee0fd81c58 (127.18.112.66:34531)
I20260810 03:14:40.936405 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.929601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41141 (local address 127.18.112.66:34531)
0810 03:14:40.929853 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.929860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.929930 (+ 70us) server_negotiation.cc:407] Connection header received
0810 03:14:40.930174 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.930178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.930284 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.930362 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:14:40.930794 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.931851 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.934095 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.935237 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.935377 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.935449 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.935922 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.936043 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:14:40.936405 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.929547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:34531 (local address 127.18.112.67:41141)
0810 03:14:40.929823 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.929843 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.929988 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.930414 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.930419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.930449 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:14:40.930666 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.930675 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.932012 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.932016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.933951 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.933963 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.935385 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.935391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.935718 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.935744 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.935884 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.936019 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":44}
I20260810 03:14:40.937556 3898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016ee55217444d59919a5fca910f2115" candidate_uuid: "cb8c0fa753834b528e8a817ea7c24182" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b9d47b6bf041769c088eee0fd81c58" is_pre_election: true
I20260810 03:14:40.938048 3898 raft_consensus.cc:2454] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb8c0fa753834b528e8a817ea7c24182 in term 0.
I20260810 03:14:40.938827 3999 leader_election.cc:302] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8b9d47b6bf041769c088eee0fd81c58, cb8c0fa753834b528e8a817ea7c24182; no voters:
I20260810 03:14:40.939260 4218 raft_consensus.cc:2781] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:14:40.939522 4218 raft_consensus.cc:482] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:14:40.939596 4196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.929535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41203 (local address 127.18.112.65:40789)
0810 03:14:40.929761 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.929768 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.931280 (+ 1512us) server_negotiation.cc:407] Connection header received
0810 03:14:40.931439 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.931444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.931520 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.931597 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:14:40.932742 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.934053 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.937098 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.938541 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.938722 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.938802 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.939148 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.939273 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:14:40.939730 4219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.929886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40789 (local address 127.18.112.67:41203)
0810 03:14:40.931177 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0810 03:14:40.931191 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:14:40.931311 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:14:40.931623 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:14:40.931627 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:14:40.931653 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:14:40.932463 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.932479 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.934243 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.934247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.936824 (+ 2577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:14:40.936841 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.938841 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.938849 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:14:40.938996 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.939027 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:14:40.939119 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 03:14:40.939245 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1194,"mutex_wait_us":20,"thread_start_us":962,"threads_started":1}
I20260810 03:14:40.939782 4218 raft_consensus.cc:3037] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:14:40.940682 3677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016ee55217444d59919a5fca910f2115" candidate_uuid: "cb8c0fa753834b528e8a817ea7c24182" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" is_pre_election: true
I20260810 03:14:40.941311 3677 raft_consensus.cc:2454] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb8c0fa753834b528e8a817ea7c24182 in term 0.
I20260810 03:14:40.942714 4218 raft_consensus.cc:504] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.943327 4218 leader_election.cc:288] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [CANDIDATE]: Term 1 election: Requested vote from peers ecbb74e12a5e4e4aa28362d6f3913198 (127.18.112.65:40789), a8b9d47b6bf041769c088eee0fd81c58 (127.18.112.66:34531)
I20260810 03:14:40.943849 3677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016ee55217444d59919a5fca910f2115" candidate_uuid: "cb8c0fa753834b528e8a817ea7c24182" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbb74e12a5e4e4aa28362d6f3913198"
I20260810 03:14:40.943957 3898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016ee55217444d59919a5fca910f2115" candidate_uuid: "cb8c0fa753834b528e8a817ea7c24182" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b9d47b6bf041769c088eee0fd81c58"
I20260810 03:14:40.944149 3677 raft_consensus.cc:3037] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:14:40.944178 3898 raft_consensus.cc:3037] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:14:40.946331 3898 raft_consensus.cc:2454] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb8c0fa753834b528e8a817ea7c24182 in term 1.
I20260810 03:14:40.946372 3677 raft_consensus.cc:2454] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb8c0fa753834b528e8a817ea7c24182 in term 1.
I20260810 03:14:40.946805 3999 leader_election.cc:302] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8b9d47b6bf041769c088eee0fd81c58, cb8c0fa753834b528e8a817ea7c24182; no voters:
I20260810 03:14:40.947069 4218 raft_consensus.cc:2781] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:14:40.948027 4218 raft_consensus.cc:686] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 1 LEADER]: Becoming Leader. State: Replica: cb8c0fa753834b528e8a817ea7c24182, State: Running, Role: LEADER
I20260810 03:14:40.948683 4218 consensus_queue.cc:237] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } }
I20260810 03:14:40.953516 3428 catalog_manager.cc:5495] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb8c0fa753834b528e8a817ea7c24182 (127.18.112.67). New cstate: current_term: 1 leader_uuid: "cb8c0fa753834b528e8a817ea7c24182" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb8c0fa753834b528e8a817ea7c24182" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 43347 } health_report { overall_health: HEALTHY } } }
I20260810 03:14:40.975021 4202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:40.969469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47904 (local address 127.18.112.67:43347)
0810 03:14:40.969691 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:40.969696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:40.969797 (+ 101us) server_negotiation.cc:407] Connection header received
0810 03:14:40.969969 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:40.969972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:40.970040 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:40.970151 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:14:40.970430 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.971269 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.973101 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:40.973527 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:40.973618 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:40.974140 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:14:40.974575 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:14:40.974693 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:40.974755 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 03:14:40.974813 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:14:40.984431 3898 raft_consensus.cc:1261] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 1 FOLLOWER]: Refusing update from remote peer cb8c0fa753834b528e8a817ea7c24182: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:14:40.984442 3677 raft_consensus.cc:1261] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 1 FOLLOWER]: Refusing update from remote peer cb8c0fa753834b528e8a817ea7c24182: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:14:40.985476 4221 consensus_queue.cc:1035] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b9d47b6bf041769c088eee0fd81c58" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 34531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:14:40.985984 4218 consensus_queue.cc:1035] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecbb74e12a5e4e4aa28362d6f3913198" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:14:40.993724 4169 tablet.cc:2369] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:14:40.997512 4226 mvcc.cc:205] Tried to move back new op lower bound from 7316814565301829632 to 7316814565169602560. Current Snapshot: MvccSnapshot[applied={T|T < 7316814565301829632}]
I20260810 03:14:41.015127 3428 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:14:41.015363 3428 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:14:41.019055 3428 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82becf3d75d742d4960b3de34a0e3618: Sending DeleteTablet for 3 replicas of tablet 016ee55217444d59919a5fca910f2115
I20260810 03:14:41.020221 3647 tablet_service.cc:1514] Processing DeleteTablet for tablet 016ee55217444d59919a5fca910f2115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:14:41 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:47206
I20260810 03:14:41.020757 4070 tablet_service.cc:1514] Processing DeleteTablet for tablet 016ee55217444d59919a5fca910f2115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:14:41 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:47890
I20260810 03:14:41.021111 3868 tablet_service.cc:1514] Processing DeleteTablet for tablet 016ee55217444d59919a5fca910f2115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:14:41 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:44018
I20260810 03:14:41.021935 4243 tablet_replica.cc:330] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: stopping tablet replica
I20260810 03:14:41.022763 4243 raft_consensus.cc:2229] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:14:41.023034 4245 tablet_replica.cc:330] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: stopping tablet replica
I20260810 03:14:41.023414 4243 raft_consensus.cc:2258] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:14:41.023438 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 3550
I20260810 03:14:41.023475 4245 raft_consensus.cc:2229] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:14:41.024454 4245 raft_consensus.cc:2258] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:14:41.028028 4243 ts_tablet_manager.cc:1905] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:14:41.032230 4244 tablet_replica.cc:330] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: stopping tablet replica
I20260810 03:14:41.032521 4244 raft_consensus.cc:2229] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:14:41.033043 4244 raft_consensus.cc:2258] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:14:41.035013 4244 ts_tablet_manager.cc:1905] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:14:41.035727 4243 ts_tablet_manager.cc:1918] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:14:41.036018 4243 log.cc:1196] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/016ee55217444d59919a5fca910f2115
I20260810 03:14:41.036558 4243 ts_tablet_manager.cc:1939] T 016ee55217444d59919a5fca910f2115 P ecbb74e12a5e4e4aa28362d6f3913198: Deleting consensus metadata
I20260810 03:14:41.038297 3410 catalog_manager.cc:4841] TS ecbb74e12a5e4e4aa28362d6f3913198 (127.18.112.65:40789): tablet 016ee55217444d59919a5fca910f2115 (table test-table [id=e8d1462cd2d94b61842e65f24da4fedc]) successfully deleted
I20260810 03:14:41.038829 4245 ts_tablet_manager.cc:1905] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:14:41.044178 4244 ts_tablet_manager.cc:1918] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:14:41.044502 4244 log.cc:1196] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/016ee55217444d59919a5fca910f2115
I20260810 03:14:41.045329 4244 ts_tablet_manager.cc:1939] T 016ee55217444d59919a5fca910f2115 P cb8c0fa753834b528e8a817ea7c24182: Deleting consensus metadata
Aug 10 03:14:41 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:14:41.045873 4245 ts_tablet_manager.cc:1918] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:14:41.046043 4245 log.cc:1196] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/016ee55217444d59919a5fca910f2115
I20260810 03:14:41.046543 4245 ts_tablet_manager.cc:1939] T 016ee55217444d59919a5fca910f2115 P a8b9d47b6bf041769c088eee0fd81c58: Deleting consensus metadata
I20260810 03:14:41.047382 3407 catalog_manager.cc:4841] TS cb8c0fa753834b528e8a817ea7c24182 (127.18.112.67:43347): tablet 016ee55217444d59919a5fca910f2115 (table test-table [id=e8d1462cd2d94b61842e65f24da4fedc]) successfully deleted
I20260810 03:14:41.048520 3408 catalog_manager.cc:4841] TS a8b9d47b6bf041769c088eee0fd81c58 (127.18.112.66:34531): tablet 016ee55217444d59919a5fca910f2115 (table test-table [id=e8d1462cd2d94b61842e65f24da4fedc]) successfully deleted
I20260810 03:14:41.054189 4196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:41.024866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47222 (local address 127.18.112.65:40789)
0810 03:14:41.025030 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:41.025036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:41.034856 (+ 9820us) server_negotiation.cc:407] Connection header received
0810 03:14:41.035251 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:41.035256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:41.035334 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:41.035407 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:41.037336 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.038531 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.040468 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.041065 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.041159 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:41.046852 (+ 5693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:41.046865 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:41.046881 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:41.046979 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:41.050984 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.052024 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.052030 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.052033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.052158 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.052596 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.052599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.052601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.052939 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:41.053160 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:41.053536 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 03:14:41.053720 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:14:41.055020 3741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:14:41.157277 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 3550
I20260810 03:14:41.182466 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 3756
Aug 10 03:14:41 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:14:41.197551 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:41.183286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44022 (local address 127.18.112.66:34531)
0810 03:14:41.183482 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:41.183488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:41.183509 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:14:41.183642 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:41.183648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:41.183720 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:41.183831 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:41.185185 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.185951 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.187319 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.187719 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.187940 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:41.192107 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:41.192122 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:41.192138 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:41.192178 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:41.194960 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.195581 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.195588 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.195591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.195718 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.196085 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.196089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.196091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.196440 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:41.196728 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:41.197008 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 03:14:41.197221 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:14:41.198184 3959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:14:41.349002 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 3756
I20260810 03:14:41.371354 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 3975
Aug 10 03:14:41 dist-test-slave-jlzn krb5kdc[2708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:14:41.389921 4202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:14:41.372204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.18.112.67:43347)
0810 03:14:41.372369 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:14:41.372373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:14:41.372391 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:14:41.372582 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:14:41.372586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:14:41.372657 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:14:41.372738 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:14:41.374575 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.375399 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.377445 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:14:41.377881 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:14:41.377975 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:14:41.383272 (+ 5297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:14:41.383284 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:14:41.383301 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:14:41.383353 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:14:41.387171 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.387772 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.387781 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.387785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.388021 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:14:41.388372 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:14:41.388377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:14:41.388380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:14:41.388873 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:14:41.389187 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0810 03:14:41.389335 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 03:14:41.389548 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 03:14:41.390762 4157 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:14:41.510962 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 3975
I20260810 03:14:41.538362 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 3381
I20260810 03:14:41.539552 3476 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:14:41.649173 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 3381
I20260810 03:14:41.676004 18881 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 03:14:42.019829 18881 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 03:14:42.020031 18881 mini_ranger.cc:66] Stopping Ranger...
I20260810 03:14:42.363754 18881 mini_ranger.cc:68] Stopped Ranger
2026-08-10 03:14:42.364 UTC [2751] LOG: received smart shutdown request
2026-08-10 03:14:42.367 UTC [2751] LOG: background worker "logical replication launcher" (PID 2765) exited with exit code 1
2026-08-10 03:14:42.367 UTC [2759] LOG: shutting down
2026-08-10 03:14:42.490 UTC [2751] LOG: database system is shut down
2026-08-10T03:14:42Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49196 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:14:42 dist-test-slave-jlzn krb5kdc[4267](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:14:42 dist-test-slave-jlzn krb5kdc[4267](info): set up 2 sockets
Aug 10 03:14:42 dist-test-slave-jlzn krb5kdc[4267](info): commencing operation
krb5kdc: starting...
W20260810 03:14:43.783061 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:14:43 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:14:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:14:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangeradmin_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangeradmin_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangerlookup_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangerlookup_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
I20260810 03:14:44.089768 18881 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJGLf1q/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/postgres -l logfile start
2026-08-10 03:14:46.217 UTC [4313] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 03:14:46.217 UTC [4313] LOG: listening on IPv4 address "127.18.112.84", port 60281
2026-08-10 03:14:46.221 UTC [4313] LOG: listening on Unix socket "/tmp/.s.PGSQL.60281"
2026-08-10 03:14:46.243 UTC [4317] LOG: database system was shut down at 2026-08-10 03:14:45 UTC
2026-08-10 03:14:46.246 UTC [4313] LOG: database system is ready to accept connections
I20260810 03:14:47.301738 18881 mini_postgres.cc:96] Postgres bound to 60281
2026-08-10 03:14:47.322 UTC [4334] FATAL: database "slave" does not exist
127.18.112.84:60281 - accepting connections
I20260810 03:14:47.323041 18881 mini_ranger.cc:161] Starting Ranger...
I20260810 03:14:47.348593 18881 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 03:14:47.731532 18881 mini_ranger.cc:87] Created ranger Postgres database
I20260810 03:14:47.731642 18881 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin
2026-08-10 03:14:48,019 [I] DB FLAVOR :POSTGRES
2026-08-10 03:14:48,020 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:14:48,020 [I] Checking connection..
2026-08-10 03:14:48,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 03:14:48,271 [I] Checking connection passed.
2026-08-10 03:14:48,271 [I] --------- Verifying version history table ---------
2026-08-10 03:14:48,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:48,523 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:14:48,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:48,761 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:14:48,761 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 03:14:48,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 03:14:49.007 UTC [4430] WARNING: there is no transaction in progress
2026-08-10 03:14:49,015 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 03:14:49,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:14:49,269 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 03:14:49,269 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:14:49,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 03:14:49,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 03:14:49,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-10 03:14:49,991 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:14:50,248 [I] Table x_portal_user does not exist in database ranger
2026-08-10 03:14:50,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:14:50,500 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 03:14:50,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:14:50,741 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:14:50,974 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 03:14:50,974 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 03:14:51.822 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.835 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.849 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.862 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.876 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.891 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.939 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.944 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.956 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.965 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.974 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.986 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.994 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:51.999 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:52.005 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:52.010 UTC [4590] WARNING: there is no transaction in progress
2026-08-10 03:14:52,535 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 03:14:52,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 03:14:52,761 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 03:14:52,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:14:52,994 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 03:14:52,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:14:53,248 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 03:14:53,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:14:53,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:14:53,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-10 03:14:53,983 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 03:14:53,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 03:14:54,217 [I] DB_PATCHES have already been applied
I20260810 03:14:54.223618 18881 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJGLf1q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 03:14:54.223717 18881 mini_ranger.cc:193] Using host: 127.18.112.84
I20260810 03:14:54.241561 18881 mini_ranger.cc:227] Ranger admin URL: http://127.18.112.84:36635
Aug 10, 2026 3:14:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:14:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:14:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:14:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:14:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:14:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:14:55 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 03:14:55.441114 18881 mini_ranger.cc:160] Time spent starting Ranger: real 8.118s user 0.000s sys 0.047s
Aug 10, 2026 3:15:14 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:15:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 3:15:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:15:14 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:15:15 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 03:15:16.391929 18881 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.112.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.112.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangerkms_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.112.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/rangerkms_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.112.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.112.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.112.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/HTTP_127.18.112.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 03:15:16 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331716, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 03:15:16.585978 18881 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 03:15:16.608618 18881 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 03:15:17.336449 18881 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 03:15:17.336568 18881 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms
I20260810 03:15:17.336618 18881 mini_ranger_kms.cc:227] Using postgres at 127.18.112.84:60281
2026-08-10 03:15:17,682 [I] DB FLAVOR :POSTGRES
2026-08-10 03:15:17,682 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:15:17,682 [I] Checking connection
2026-08-10 03:15:17,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 03:15:17,958 [I] connection success
2026-08-10 03:15:17,958 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 03:15:17,959 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 03:15:17,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 03:15:18,279 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 03:15:18,279 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:15:18,280 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 03:15:18,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.112.84:60281/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 03:15:18,572 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 03:15:19.014163 18881 mini_ranger_kms.cc:310] Created kms service
I20260810 03:15:19.198933 18881 mini_ranger_kms.cc:326] Created kudu user
I20260810 03:15:19.239408 18881 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 03:15:19 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331716, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:19.626878 18881 mini_ranger_kms.cc:384] Added ranger policy
I20260810 03:15:19.627218 18881 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJGLf1q/build/asan/bin/postgresql.jar:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJGLf1q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 03:15:19.627279 18881 mini_ranger_kms.cc:240] Using host: 127.18.112.84
I20260810 03:15:19.645669 18881 mini_ranger_kms.cc:276] Ranger KMS PID: 4847
I20260810 03:15:19.645782 18881 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.112.84:39137
Aug 10, 2026 3:15:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:15:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:15:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:15:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:15:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:15:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 03:15:22 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786331722, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:22.195326 18881 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.609s user 0.048s sys 0.321s
I20260810 03:15:22.195611 18881 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 03:15:22.195860 18881 mini_ranger_kms.cc:401] 127.18.112.84:39137/kms/v1/keys
Aug 10 03:15:22 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331722, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:15:22 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331722, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.112.84@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:15:25 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:15:25.250944 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35017
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35017
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:25.576946 4920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:25.577209 4920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:25.577310 4920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:25.584257 4920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:25.584357 4920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:25.584409 4920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:25.584467 4920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:25.584522 4920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:25.594041 4920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.112.84:39137/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35017
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:25.595145 4920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:25.596393 4920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:25.607527 4927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:25.607551 4936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:25.607491 4928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:25.608290 4920 server_base.cc:1034] running on GCE node
I20260810 03:15:25.609001 4920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:25.610235 4920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:25.611415 4920 hybrid_clock.cc:648] HybridClock initialized: now 1786331725611376 us; error 42 us; skew 500 ppm
I20260810 03:15:25.611737 4920 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:25 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:25.618481 4920 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:25.619735 4920 webserver.cc:460] Webserver started at http://127.18.112.126:43261/ using document root <none> and password file <none>
I20260810 03:15:25.620324 4920 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:25.620421 4920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:25.620661 4920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:15:25 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:25.677462 4920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "ec12cc3dc2e4496a84c152d868d6febd"
format_stamp: "Formatted at 2026-08-10 03:15:25 on dist-test-slave-jlzn"
server_key: "8faa2bde35e0f3ab7e28f0d554e7cf36"
server_key_iv: "3c5d79004bb51197a23ac03a05e066fc"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:25.678287 4920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "ec12cc3dc2e4496a84c152d868d6febd"
format_stamp: "Formatted at 2026-08-10 03:15:25 on dist-test-slave-jlzn"
server_key: "8faa2bde35e0f3ab7e28f0d554e7cf36"
server_key_iv: "3c5d79004bb51197a23ac03a05e066fc"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:25.683480 4920 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 03:15:25.702040 4948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:25.703785 4920 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 03:15:25.703991 4920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "ec12cc3dc2e4496a84c152d868d6febd"
format_stamp: "Formatted at 2026-08-10 03:15:25 on dist-test-slave-jlzn"
server_key: "8faa2bde35e0f3ab7e28f0d554e7cf36"
server_key_iv: "3c5d79004bb51197a23ac03a05e066fc"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:25.704245 4920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:25.728381 4920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:25.732139 4920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:25.732390 4920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:25.749073 4920 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35017
I20260810 03:15:25.749114 5024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35017 every 8 connection(s)
I20260810 03:15:25.750281 4920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:25.751356 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 4920
I20260810 03:15:25.751565 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:15:25.752280 18881 external_mini_cluster.cc:1428] Setting key a58001f41fcad9815402daff7ecde51c
I20260810 03:15:25.754302 5025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 03:15:25 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:25.766731 5025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Bootstrap starting.
I20260810 03:15:25.769680 5025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:25.770870 5025 log.cc:824] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:25.773581 5029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:25.754133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.18.112.126:35017)
0810 03:15:25.754907 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:25.754918 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:25.754957 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:15:25.756550 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:25.756571 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:25.756923 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:25.757242 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:25.758860 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:25.760231 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:25.761969 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:25.762568 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:25.762710 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:25.766930 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:25.766942 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:25.766955 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:25.766988 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:25.769721 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:25.770505 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:25.770511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:25.770517 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:25.770685 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:25.771095 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:25.771099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:25.771101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:25.771751 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:25.772080 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:25.772384 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 03:15:25.772677 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":362,"threads_started":1}
I20260810 03:15:25.773833 5025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: No bootstrap required, opened a new log
I20260810 03:15:25.781525 5025 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:25.781881 5025 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:25.781976 5025 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec12cc3dc2e4496a84c152d868d6febd, State: Initialized, Role: FOLLOWER
I20260810 03:15:25.782482 5025 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:25.782701 5025 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:25.782823 5025 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:25.782972 5025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:25.785174 5025 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:25.785804 5025 leader_election.cc:302] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec12cc3dc2e4496a84c152d868d6febd; no voters:
I20260810 03:15:25.786358 5025 leader_election.cc:288] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:15:25.786459 5032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:25.787065 5032 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 LEADER]: Becoming Leader. State: Replica: ec12cc3dc2e4496a84c152d868d6febd, State: Running, Role: LEADER
I20260810 03:15:25.787567 5032 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:25.788210 5025 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:25.790010 5033 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec12cc3dc2e4496a84c152d868d6febd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } } }
I20260810 03:15:25.790158 5035 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec12cc3dc2e4496a84c152d868d6febd. Latest consensus state: current_term: 1 leader_uuid: "ec12cc3dc2e4496a84c152d868d6febd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } } }
I20260810 03:15:25.790428 5033 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:25.790460 5035 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:25.796713 5042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:25.797453 5025 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 03:15:25.809947 5042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:25.820168 5042 catalog_manager.cc:1347] Generated new cluster ID: 1709255abebf4101ad043c2693d8ad09
I20260810 03:15:25.820282 5042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:25.852626 5042 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:15:25.854524 5042 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:25.861935 5042 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Generated new TSK 0
I20260810 03:15:25.862913 5042 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:15:26.553042 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:15:26 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786331726, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 03:15:26.967288 5097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:26.967658 5097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:26.967890 5097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:26.979358 5097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:26.979561 5097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:26.979758 5097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:15:26.995217 5097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:26.996867 5097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:26.998538 5097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:27.016739 5113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:27.017309 5114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:27.026427 5097 server_base.cc:1034] running on GCE node
W20260810 03:15:27.026926 5117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:27.027760 5097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:27.029796 5097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:27.031083 5097 hybrid_clock.cc:648] HybridClock initialized: now 1786331727030983 us; error 88 us; skew 500 ppm
I20260810 03:15:27.031530 5097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:27 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331727, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:27.035871 5097 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:15:27.047550 5097 webserver.cc:460] Webserver started at http://127.18.112.65:33033/ using document root <none> and password file <none>
I20260810 03:15:27.048537 5097 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:27.048784 5097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:27.049180 5097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:15:27 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331727, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:27.071171 5097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "d626ad13d4c446df8ad3525d682551b5"
format_stamp: "Formatted at 2026-08-10 03:15:27 on dist-test-slave-jlzn"
server_key: "039eb8a8cdd3e1e2c4b339c89be6590d"
server_key_iv: "f3da87a8db4aad3262b25dbaceed40fa"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:27.072352 5097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "d626ad13d4c446df8ad3525d682551b5"
format_stamp: "Formatted at 2026-08-10 03:15:27 on dist-test-slave-jlzn"
server_key: "039eb8a8cdd3e1e2c4b339c89be6590d"
server_key_iv: "f3da87a8db4aad3262b25dbaceed40fa"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:27.079437 5097 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260810 03:15:27.112432 5126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:27.118182 5097 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.007s sys 0.008s
I20260810 03:15:27.118391 5097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "d626ad13d4c446df8ad3525d682551b5"
format_stamp: "Formatted at 2026-08-10 03:15:27 on dist-test-slave-jlzn"
server_key: "039eb8a8cdd3e1e2c4b339c89be6590d"
server_key_iv: "f3da87a8db4aad3262b25dbaceed40fa"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:27.118667 5097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:27.184315 5097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:27.189795 5097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:27.190217 5097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:27.204214 5097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:27.216650 5097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:27.216830 5097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:27.217031 5097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:27.217150 5097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:15:27 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331726, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:15:27 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331726, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:27.783969 5298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44405 every 8 connection(s)
I20260810 03:15:27.784408 5097 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44405
I20260810 03:15:27.786250 5097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:15:27.794030 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 5097
I20260810 03:15:27.794230 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:15:27.795058 18881 external_mini_cluster.cc:1428] Setting key 29b49282e7f9cbc8ee9913e2b1cc7327
Aug 10 03:15:27 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331727, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:27.839969 5304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:27.796165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.65:50699)
0810 03:15:27.808700 (+ 12535us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:27.808756 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:27.811204 (+ 2448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:27.816979 (+ 5775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:27.816993 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:27.817935 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:27.818774 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:27.818802 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:27.821382 (+ 2580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:27.821387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:27.825310 (+ 3923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:27.825326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:27.827302 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:27.827310 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:27.827604 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:27.828415 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:27.828446 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:27.831248 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:27.835295 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:27.835304 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:27.835321 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:27.835918 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:27.836375 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:27.836380 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:27.836384 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:27.836635 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:27.837327 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:27.837335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:27.837767 (+ 432us) client_negotiation.cc:769] Sending connection context
0810 03:15:27.838070 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 03:15:27.838591 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12164,"thread_start_us":15380,"threads_started":1}
I20260810 03:15:27.841066 5301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:27.795556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:50699 (local address 127.18.112.126:35017)
0810 03:15:27.816217 (+ 20661us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:27.816223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:27.816245 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:15:27.816311 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:27.816317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:27.816402 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:27.816506 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:27.819013 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:27.821194 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:27.825494 (+ 4300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:27.826223 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:27.826338 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:27.831538 (+ 5200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:27.831546 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:27.831551 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:27.831604 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:27.835080 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:27.836094 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:27.836099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:27.836103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:27.836251 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:27.836767 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:27.836772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:27.836775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:27.837118 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:27.837242 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:27.840471 (+ 3229us) server_negotiation.cc:299] Negotiation successful
0810 03:15:27.840697 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20524,"thread_start_us":20553,"threads_started":1}
I20260810 03:15:27.843312 5299 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:27.843644 5299 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:27.844507 5299 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:27.846998 4970 ts_manager.cc:194] Registered new tserver with Master: d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405)
I20260810 03:15:27.848981 4970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:50699
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
W20260810 03:15:27.899420 18881 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.18.112.66: real 0.101s user 0.001s sys 0.021s
I20260810 03:15:27.900341 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:28.294826 5311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:28.295105 5311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:28.295238 5311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:28.302110 5311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:28.302217 5311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:28.302356 5311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:15:28.311753 5311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:28.312904 5311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:28.314114 5311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:28.327924 5330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:28.327965 5331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:28.328810 5334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:28.329037 5311 server_base.cc:1034] running on GCE node
I20260810 03:15:28.329643 5311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:28.330516 5311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:28.331718 5311 hybrid_clock.cc:648] HybridClock initialized: now 1786331728331665 us; error 54 us; skew 500 ppm
I20260810 03:15:28.332024 5311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:28.335317 5311 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:15:28.336678 5311 webserver.cc:460] Webserver started at http://127.18.112.66:34071/ using document root <none> and password file <none>
I20260810 03:15:28.337287 5311 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:28.337393 5311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:28.337693 5311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:28.355372 5311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "c3932c766d13408fa47cf8c0a6385e8f"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "123b084b92822da6707539a7026de103"
server_key_iv: "be674383fce2a37fac00e3566e91da1e"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.356186 5311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "c3932c766d13408fa47cf8c0a6385e8f"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "123b084b92822da6707539a7026de103"
server_key_iv: "be674383fce2a37fac00e3566e91da1e"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.361171 5311 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 03:15:28.376791 5346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.378399 5311 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:28.378574 5311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "c3932c766d13408fa47cf8c0a6385e8f"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "123b084b92822da6707539a7026de103"
server_key_iv: "be674383fce2a37fac00e3566e91da1e"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.378806 5311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:28.401201 5311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:28.405597 5311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:28.405905 5311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:28.406951 5311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:28.408592 5311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:28.408695 5311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.408818 5311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:28.408887 5311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.440148 5311 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:43065
I20260810 03:15:28.440176 5520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:43065 every 8 connection(s)
I20260810 03:15:28.441447 5311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:15:28.451694 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 5311
I20260810 03:15:28.451862 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:15:28.452307 18881 external_mini_cluster.cc:1428] Setting key 38112261b8a8078c5a5f138d2847cb29
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:28.460635 5523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:28.443904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:55569 (local address 127.18.112.126:35017)
0810 03:15:28.444398 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:28.444402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:28.445232 (+ 830us) server_negotiation.cc:407] Connection header received
0810 03:15:28.447048 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:28.447052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:28.447119 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:28.447204 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:28.448574 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.449348 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.450785 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.451192 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.451277 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:28.454671 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:28.454677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:28.454682 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:28.454718 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:28.457744 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:28.458401 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:28.458406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:28.458409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:28.458562 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:28.458981 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:28.458986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:28.458989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:28.459325 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:28.459463 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:28.460085 (+ 622us) server_negotiation.cc:299] Negotiation successful
0810 03:15:28.460288 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":261,"threads_started":1}
I20260810 03:15:28.461279 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:28.444388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.66:55569)
0810 03:15:28.445060 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:28.445105 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:28.446794 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:28.447394 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:28.447402 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:28.447826 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:28.448405 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:28.448424 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.449473 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.449477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:28.450679 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:28.450692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.451350 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.451354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:28.451553 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:28.452215 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:28.452237 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:28.454477 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:28.457866 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:28.457873 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:28.457883 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:28.458282 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:28.458648 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:28.458651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:28.458653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:28.458874 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:28.459426 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:28.459432 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:28.459700 (+ 268us) client_negotiation.cc:769] Sending connection context
0810 03:15:28.459949 (+ 249us) client_negotiation.cc:240] Negotiation successful
0810 03:15:28.460293 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":264,"threads_started":1}
I20260810 03:15:28.462575 5521 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:28.462873 5521 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:28.463639 5521 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:28.465111 4970 ts_manager.cc:194] Registered new tserver with Master: c3932c766d13408fa47cf8c0a6385e8f (127.18.112.66:43065)
I20260810 03:15:28.465883 4970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:55569
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:15:28.506770 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:28.823657 5530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:28.823952 5530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:28.824116 5530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:28.831451 5530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:28.831570 5530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:28.831722 5530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:15:28.841140 5530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:28.842278 5530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:28.843523 5530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:15:28.852732 5299 heartbeater.cc:503] Master 127.18.112.126:35017 was elected leader, sending a full tablet report...
W20260810 03:15:28.856176 5541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:28.856256 5544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:28.856348 5540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:28.860986 5530 server_base.cc:1034] running on GCE node
I20260810 03:15:28.861573 5530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:28.862432 5530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:28.863656 5530 hybrid_clock.cc:648] HybridClock initialized: now 1786331728863602 us; error 28 us; skew 500 ppm
I20260810 03:15:28.864078 5530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:28.868430 5530 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:15:28.870247 5530 webserver.cc:460] Webserver started at http://127.18.112.67:45441/ using document root <none> and password file <none>
I20260810 03:15:28.870883 5530 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:28.870983 5530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:28.871233 5530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:28.886582 5530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "7ca351a589b74ee99a3ce41460cd510b"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "e3b919a1c7d6f678cbac7512e77b199c"
server_key_iv: "228500886452bfb15d934b510d26cac9"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.887368 5530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "7ca351a589b74ee99a3ce41460cd510b"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "e3b919a1c7d6f678cbac7512e77b199c"
server_key_iv: "228500886452bfb15d934b510d26cac9"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.892453 5530 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 03:15:28.907114 5554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.908447 5530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:15:28.908619 5530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "7ca351a589b74ee99a3ce41460cd510b"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "e3b919a1c7d6f678cbac7512e77b199c"
server_key_iv: "228500886452bfb15d934b510d26cac9"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:28.908804 5530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:28.934402 5530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:28.938104 5530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:28.938375 5530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:28.939247 5530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:28.940542 5530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:28.940616 5530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.940737 5530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:28.940788 5530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:28.970651 5530 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:41763
I20260810 03:15:28.970691 5716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:41763 every 8 connection(s)
I20260810 03:15:28.971848 5530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:15:28.976676 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 5530
I20260810 03:15:28.976804 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:15:28.977248 18881 external_mini_cluster.cc:1428] Setting key c993338bedfcdc52e1865f38cd5133b6
Aug 10 03:15:28 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:28.990769 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:28.974200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:38001 (local address 127.18.112.126:35017)
0810 03:15:28.974701 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:28.974707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:28.975516 (+ 809us) server_negotiation.cc:407] Connection header received
0810 03:15:28.977322 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:28.977327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:28.977413 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:28.977536 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:28.978998 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.980009 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.981603 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.982056 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.982173 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:28.985385 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:28.985390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:28.985393 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:28.985425 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:28.987762 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:28.988526 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:28.988532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:28.988534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:28.988660 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:28.989064 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:28.989069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:28.989072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:28.989375 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:28.989510 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:28.990171 (+ 661us) server_negotiation.cc:299] Negotiation successful
0810 03:15:28.990389 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":204,"threads_started":1}
I20260810 03:15:28.991719 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:28.974660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.67:38001)
0810 03:15:28.975362 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:28.975406 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:28.977065 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:28.977727 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:28.977735 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:28.978234 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:28.978842 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:28.978860 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.980160 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.980163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:28.981465 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:28.981478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:28.982274 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:28.982281 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:28.982498 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:28.983132 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:28.983161 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:28.985184 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:28.987927 (+ 2743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:28.987936 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:28.987950 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:28.988413 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:28.988760 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:28.988766 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:28.988770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:28.988958 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:28.989508 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:28.989516 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:28.989830 (+ 314us) client_negotiation.cc:769] Sending connection context
0810 03:15:28.990056 (+ 226us) client_negotiation.cc:240] Negotiation successful
0810 03:15:28.990496 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":268,"threads_started":1}
I20260810 03:15:28.992923 5717 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:28.993208 5717 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:28.993956 5717 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:28.995266 4970 ts_manager.cc:194] Registered new tserver with Master: 7ca351a589b74ee99a3ce41460cd510b (127.18.112.67:41763)
I20260810 03:15:28.996116 4970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:38001
I20260810 03:15:29.004441 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:15:29.006099 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 5097
Aug 10 03:15:29 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:15:29.022861 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:29.006850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52196 (local address 127.18.112.65:44405)
0810 03:15:29.007418 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:29.007426 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:29.007453 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:15:29.007555 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:29.007563 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:29.007753 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:29.007909 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:29.009289 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.010424 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.011984 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.012524 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.012618 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:29.017675 (+ 5057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:29.017686 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:29.017698 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:29.017730 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:29.020212 (+ 2482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.020863 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.020869 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.020872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.021001 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.021341 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.021345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.021347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.021677 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:29.021973 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:29.022292 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 03:15:29.022546 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":256,"threads_started":1}
I20260810 03:15:29.024196 5293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:29.103645 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 5097
I20260810 03:15:29.126713 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 5311
Aug 10 03:15:29 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:15:29.141875 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:29.127561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43458 (local address 127.18.112.66:43065)
0810 03:15:29.128117 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:29.128124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:29.128157 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:15:29.128218 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:29.128225 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:29.128441 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:29.128563 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:29.129768 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.130743 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.132013 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.132564 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.132664 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:29.136591 (+ 3927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:29.136602 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:29.136615 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:29.136656 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:29.139296 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.140081 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.140089 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.140091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.140223 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.140527 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.140530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.140532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.140854 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:29.141076 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:29.141288 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 03:15:29.141516 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":279,"threads_started":1}
I20260810 03:15:29.143096 5515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:29.222271 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 5311
I20260810 03:15:29.244089 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 5530
Aug 10 03:15:29 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:15:29.259021 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:29.244974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42698 (local address 127.18.112.67:41763)
0810 03:15:29.245529 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:29.245536 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:29.245565 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:15:29.245623 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:29.245639 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:29.245852 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:29.245972 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:29.247158 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.248269 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.249488 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:29.250040 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:29.250134 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:29.254335 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:29.254346 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:29.254360 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:29.254394 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:29.256878 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.257466 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.257472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.257474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.257593 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:29.257852 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:29.257855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:29.257857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:29.258169 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:29.258405 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:29.258556 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 03:15:29.258740 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":255,"threads_started":1}
I20260810 03:15:29.260257 5709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:29.339557 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 5530
I20260810 03:15:29.361382 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 4920
I20260810 03:15:29.362627 5017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:29.465090 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 4920
I20260810 03:15:29.492633 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35017
--webserver_interface=127.18.112.126
--webserver_port=43261
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35017
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:29.808656 5735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:29.808913 5735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:29.809036 5735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:29.815987 5735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:29.816080 5735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:29.816152 5735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:29.816224 5735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:29.816288 5735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:29.825735 5735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35017
--ranger_config_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=43261
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:29.826856 5735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:29.828104 5735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:29.839056 5746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:29.839160 5741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:29.839160 5743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:29.840099 5735 server_base.cc:1034] running on GCE node
I20260810 03:15:29.840778 5735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:29.841974 5735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:29.843170 5735 hybrid_clock.cc:648] HybridClock initialized: now 1786331729843123 us; error 38 us; skew 500 ppm
I20260810 03:15:29.843489 5735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:29 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331729, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:29.846390 5735 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:29.847774 5735 webserver.cc:460] Webserver started at http://127.18.112.126:43261/ using document root <none> and password file <none>
I20260810 03:15:29.848376 5735 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:29.848481 5735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:15:30 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331729, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:30.733963 5735 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:15:30.736979 5755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:30.738286 5735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:30.738449 5735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "ec12cc3dc2e4496a84c152d868d6febd"
format_stamp: "Formatted at 2026-08-10 03:15:25 on dist-test-slave-jlzn"
server_key: "8faa2bde35e0f3ab7e28f0d554e7cf36"
server_key_iv: "3c5d79004bb51197a23ac03a05e066fc"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:30.739331 5735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:30.760641 5735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:30.763940 5735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:30.764173 5735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:30.780642 5735 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35017
I20260810 03:15:30.780650 5835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35017 every 8 connection(s)
I20260810 03:15:30.781996 5735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:30.785823 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 5735
I20260810 03:15:30.786883 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:44405
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:35017
--webserver_port=33033
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:30.789526 5837 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:15:30.793695 5837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Bootstrap starting.
I20260810 03:15:30.812307 5837 log.cc:824] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:30.820858 5837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:15:30.821349 5837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Bootstrap complete.
I20260810 03:15:30.829968 5837 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:30.830739 5837 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec12cc3dc2e4496a84c152d868d6febd, State: Initialized, Role: FOLLOWER
I20260810 03:15:30.831331 5837 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:30.831550 5837 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:30.831665 5837 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:30.831856 5837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:15:30.835376 5837 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:30.835839 5837 leader_election.cc:302] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec12cc3dc2e4496a84c152d868d6febd; no voters:
I20260810 03:15:30.836405 5837 leader_election.cc:288] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:15:30.836532 5844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:15:30.838331 5837 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:30.842572 5844 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [term 2 LEADER]: Becoming Leader. State: Replica: ec12cc3dc2e4496a84c152d868d6febd, State: Running, Role: LEADER
I20260810 03:15:30.843346 5844 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } }
I20260810 03:15:30.845840 5845 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ec12cc3dc2e4496a84c152d868d6febd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } } }
I20260810 03:15:30.846199 5845 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:30.846702 5847 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec12cc3dc2e4496a84c152d868d6febd. Latest consensus state: current_term: 2 leader_uuid: "ec12cc3dc2e4496a84c152d868d6febd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec12cc3dc2e4496a84c152d868d6febd" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35017 } } }
I20260810 03:15:30.846951 5847 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:30.848886 5857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:30.855099 5857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:30.856559 5857 catalog_manager.cc:1259] Loaded cluster ID: 1709255abebf4101ad043c2693d8ad09
I20260810 03:15:30.856714 5857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:30.860713 5857 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:30.862222 5857 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Loaded TSK: 0
I20260810 03:15:30.863745 5857 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:15:30.868331 5837 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260810 03:15:31.209136 5841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:31.209581 5841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:31.209785 5841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:31.220870 5841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:31.221050 5841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:31.221278 5841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:15:31.236123 5841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:44405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=33033
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:31.237898 5841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:31.239578 5841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:31.259943 5889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:31.259970 5890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:31.268942 5892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:31.274119 5841 server_base.cc:1034] running on GCE node
I20260810 03:15:31.274942 5841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:31.276156 5841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:31.277431 5841 hybrid_clock.cc:648] HybridClock initialized: now 1786331731277368 us; error 49 us; skew 500 ppm
I20260810 03:15:31.277807 5841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:31 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:31.282006 5841 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:15:31.284085 5841 webserver.cc:460] Webserver started at http://127.18.112.65:33033/ using document root <none> and password file <none>
I20260810 03:15:31.284915 5841 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:31.285055 5841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:15:31 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:31.331228 5841 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.003s sys 0.009s
I20260810 03:15:31.337522 5906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:31.339358 5841 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.002s
I20260810 03:15:31.339537 5841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "d626ad13d4c446df8ad3525d682551b5"
format_stamp: "Formatted at 2026-08-10 03:15:27 on dist-test-slave-jlzn"
server_key: "039eb8a8cdd3e1e2c4b339c89be6590d"
server_key_iv: "f3da87a8db4aad3262b25dbaceed40fa"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:31.340973 5841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:31.373108 5841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:31.377910 5841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:31.378211 5841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:31.379366 5841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:31.381126 5841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:31.381268 5841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 03:15:31.381397 5841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:31.381479 5841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:31.439664 5841 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44405
I20260810 03:15:31.441488 5841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:15:31.442269 6077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44405 every 8 connection(s)
I20260810 03:15:31.443784 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 5841
I20260810 03:15:31.444670 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:43065
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:35017
--webserver_port=34071
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:15:31 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:31.487377 6083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:31.446218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.65:54963)
0810 03:15:31.461786 (+ 15568us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:31.461843 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:31.465388 (+ 3545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:31.468100 (+ 2712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:31.468107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:31.468550 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:31.469086 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:31.469103 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:31.471460 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:31.471464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:31.472751 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:31.472783 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:31.473776 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:31.473785 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:31.474025 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:31.474646 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:31.474670 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:31.476795 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:31.482388 (+ 5593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:31.482396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:31.482410 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:31.482984 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:31.483536 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:31.483541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:31.483545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:31.483819 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:31.484891 (+ 1072us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:31.484899 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:31.485292 (+ 393us) client_negotiation.cc:769] Sending connection context
0810 03:15:31.485570 (+ 278us) client_negotiation.cc:240] Negotiation successful
0810 03:15:31.486085 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15274,"thread_start_us":15066,"threads_started":1}
I20260810 03:15:31.489861 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:31.446217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:54963 (local address 127.18.112.126:35017)
0810 03:15:31.466515 (+ 20298us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:31.466529 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:31.466569 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:15:31.466888 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:31.466900 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:31.467235 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:31.467577 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:31.469305 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:31.471303 (+ 1998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:31.472907 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:31.473529 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:31.473701 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:31.477024 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:31.477031 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:31.477043 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:31.477078 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:31.482206 (+ 5128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:31.483166 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:31.483175 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:31.483183 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:31.483388 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:31.483965 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:31.483971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:31.483975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:31.484614 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:31.484805 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:31.488717 (+ 3912us) server_negotiation.cc:299] Negotiation successful
0810 03:15:31.489062 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20059,"thread_start_us":22889,"threads_started":1}
I20260810 03:15:31.492470 6080 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:31.492774 6080 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:31.493458 6080 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
W20260810 03:15:31.496459 6080 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:35017 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 03:15:31.496672 6080 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:31.496903 6080 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:31.498003 6080 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:31.498250 6080 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
W20260810 03:15:31.499198 6080 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:15:31.845561 6084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:31.845866 6084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:31.846055 6084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:31.853966 6084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:31.854084 6084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:31.854243 6084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:15:31.864092 6084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:43065
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=34071
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:31.865368 6084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:31.866711 6084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:31.881718 6100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:31.881752 6103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:31.882809 6084 server_base.cc:1034] running on GCE node
W20260810 03:15:31.884061 6105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:31.884865 6084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:31.886008 6084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:31.887262 6084 hybrid_clock.cc:648] HybridClock initialized: now 1786331731887196 us; error 46 us; skew 500 ppm
I20260810 03:15:31.887637 6084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:31 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:31.891664 6084 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:15:31.893311 6084 webserver.cc:460] Webserver started at http://127.18.112.66:34071/ using document root <none> and password file <none>
I20260810 03:15:31.894177 6084 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:31.894344 6084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:15:31 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:31.922645 6084 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:15:31.925405 6125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:31.926817 6084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:15:31.926967 6084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "c3932c766d13408fa47cf8c0a6385e8f"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "123b084b92822da6707539a7026de103"
server_key_iv: "be674383fce2a37fac00e3566e91da1e"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:31.927971 6084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:31.953053 6084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:31.957919 6084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:31.958236 6084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:31.976209 6084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:31.984274 6084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:31.984440 6084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 03:15:31.984619 6084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:31.984740 6084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:32.052806 6084 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:43065
I20260810 03:15:32.052865 6295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:43065 every 8 connection(s)
I20260810 03:15:32.054371 6084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:15:32.058671 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 6084
I20260810 03:15:32.059492 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.112.84:39137/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:41763
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:35017
--webserver_port=45441
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331731, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:32.089670 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:32.057221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57307 (local address 127.18.112.126:35017)
0810 03:15:32.064147 (+ 6926us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:32.064154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:32.069144 (+ 4990us) server_negotiation.cc:407] Connection header received
0810 03:15:32.071731 (+ 2587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:32.071737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:32.071850 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:32.071964 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:32.073962 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.074731 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.076868 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.077490 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.077619 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:32.082110 (+ 4491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:32.082118 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:32.082123 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:32.082180 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:32.085811 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:32.086759 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:32.086765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:32.086769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:32.086935 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:32.087512 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:32.087518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:32.087521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:32.087915 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:32.088075 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:32.089050 (+ 975us) server_negotiation.cc:299] Negotiation successful
0810 03:15:32.089289 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6785,"thread_start_us":8603,"threads_started":1}
I20260810 03:15:32.092170 6300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:32.057876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.66:57307)
0810 03:15:32.068920 (+ 11044us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:32.068981 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:32.071352 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:32.072400 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:32.072412 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:32.072961 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:32.073736 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:32.073762 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.074914 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.074919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:32.076718 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:32.076731 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.077933 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.077940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:32.078241 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:32.079014 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:32.079051 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:32.081832 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:32.085982 (+ 4150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:32.085991 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:32.086021 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:32.086615 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:32.087099 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:32.087104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:32.087108 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:32.087374 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:32.088175 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:32.088182 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:32.088601 (+ 419us) client_negotiation.cc:769] Sending connection context
0810 03:15:32.090151 (+ 1550us) client_negotiation.cc:240] Negotiation successful
0810 03:15:32.090703 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10725,"thread_start_us":10494,"threads_started":1}
I20260810 03:15:32.094193 6296 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:32.094509 6296 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:32.095363 6296 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:32.097465 5779 ts_manager.cc:194] Registered new tserver with Master: c3932c766d13408fa47cf8c0a6385e8f (127.18.112.66:43065)
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:32.099706 5779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:57307
W20260810 03:15:32.466764 6302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:32.467108 6302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:32.467267 6302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:32.478411 6302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:32.478624 6302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:32.478874 6302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:15:32.493619 6302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.112.84:39137/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:41763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=45441
--tserver_master_addrs=127.18.112.126:35017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:32.495371 6302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:32.497014 6302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:15:32.499329 6080 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:32.499709 6080 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:32.500982 5779 ts_manager.cc:194] Registered new tserver with Master: d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405)
I20260810 03:15:32.502048 5779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:54963
W20260810 03:15:32.513170 6312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:32.514905 6315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:32.519472 6302 server_base.cc:1034] running on GCE node
W20260810 03:15:32.519932 6317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:32.520773 6302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:32.522055 6302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:32.523320 6302 hybrid_clock.cc:648] HybridClock initialized: now 1786331732523261 us; error 49 us; skew 500 ppm
I20260810 03:15:32.523700 6302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:32.527849 6302 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:15:32.532788 6302 webserver.cc:460] Webserver started at http://127.18.112.67:45441/ using document root <none> and password file <none>
I20260810 03:15:32.533761 6302 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:32.533911 6302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:32.557760 6302 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.003s
I20260810 03:15:32.561415 6328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:32.563158 6302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:32.563328 6302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "7ca351a589b74ee99a3ce41460cd510b"
format_stamp: "Formatted at 2026-08-10 03:15:28 on dist-test-slave-jlzn"
server_key: "e3b919a1c7d6f678cbac7512e77b199c"
server_key_iv: "228500886452bfb15d934b510d26cac9"
server_key_version: "kuduclusterkey@0"
I20260810 03:15:32.564695 6302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:32.652700 6302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:32.656759 6302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:32.657028 6302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:32.658098 6302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:32.659557 6302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:32.659643 6302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:32.659744 6302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:32.659827 6302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:15:32 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for HTTP/127.18.112.84@KRBTEST.COM
I20260810 03:15:32.948066 6302 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:41763
I20260810 03:15:32.949205 6501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:41763 every 8 connection(s)
I20260810 03:15:32.949977 6302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:15:32.952797 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 6302
I20260810 03:15:32.995177 6511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:32.953933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.18.112.126:35017)
0810 03:15:32.977042 (+ 23109us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:32.977061 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:32.977631 (+ 570us) server_negotiation.cc:407] Connection header received
0810 03:15:32.977938 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:32.977945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:32.978060 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:32.978144 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:32.980400 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.981577 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.983576 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:32.984330 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:32.984428 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:32.988160 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:32.988168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:32.988173 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:32.988208 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:32.991712 (+ 3504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:32.992648 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:32.992654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:32.992658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:32.992819 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:32.993280 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:32.993286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:32.993289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:32.993659 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:32.993913 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:32.994548 (+ 635us) server_negotiation.cc:299] Negotiation successful
0810 03:15:32.994779 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22957,"thread_start_us":30359,"threads_started":1}
Aug 10 03:15:33 dist-test-slave-jlzn krb5kdc[4267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331732, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:33.049189 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:32.978943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:35017 (local address 127.18.112.67:35667)
0810 03:15:33.008472 (+ 29529us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.008530 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.011844 (+ 3314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.018892 (+ 7048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.018906 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.019572 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:33.020799 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.020827 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.022459 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.022464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.024566 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.024592 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.035958 (+ 11366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.035967 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.036300 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.037123 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:33.037161 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:33.039997 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:33.044250 (+ 4253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:33.044260 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:33.044278 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:33.044868 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:33.045346 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:33.045351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:33.045354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:33.045629 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:33.046387 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:33.046394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:33.046835 (+ 441us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.047165 (+ 330us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.047727 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29188,"thread_start_us":28948,"threads_started":1}
I20260810 03:15:33.050292 6513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:32.980902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:35667 (local address 127.18.112.126:35017)
0810 03:15:32.988251 (+ 7349us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:32.988257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.008673 (+ 20416us) server_negotiation.cc:407] Connection header received
0810 03:15:33.012432 (+ 3759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.012438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.012545 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.012631 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:33.021041 (+ 8410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.022232 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.034737 (+ 12505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.035440 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.035546 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.040299 (+ 4753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:33.040307 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:33.040312 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:33.040354 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:33.044057 (+ 3703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.045038 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.045044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.045048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.045205 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.045765 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.045769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.045772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.046156 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:33.046309 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.049688 (+ 3379us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.049906 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7213,"thread_start_us":8409,"threads_started":1}
I20260810 03:15:33.052232 6503 heartbeater.cc:347] Connected to a master server at 127.18.112.126:35017
I20260810 03:15:33.052558 6503 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:33.053429 6503 heartbeater.cc:511] Master 127.18.112.126:35017 requested a full tablet report, sending...
I20260810 03:15:33.055480 5779 ts_manager.cc:194] Registered new tserver with Master: 7ca351a589b74ee99a3ce41460cd510b (127.18.112.67:41763)
I20260810 03:15:33.056592 5779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:35667
I20260810 03:15:33.061007 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:15:33.104373 6296 heartbeater.cc:503] Master 127.18.112.126:35017 was elected leader, sending a full tablet report...
I20260810 03:15:33.150106 6513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.105891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47424 (local address 127.18.112.126:35017)
0810 03:15:33.106073 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.106079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.116420 (+ 10341us) server_negotiation.cc:407] Connection header received
0810 03:15:33.116618 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.116624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.116734 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.116851 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:33.119178 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.120359 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.129503 (+ 9144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.130195 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.130304 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.142272 (+ 11968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:33.142280 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:33.142285 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:33.142332 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:33.145935 (+ 3603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.146871 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.146877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.146880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.147048 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.147552 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.147557 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.147560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.147962 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:33.148205 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.149509 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.149756 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:15:33.156378 5779 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:15:33.170353 5779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:15:33.248172 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.220247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:43065 (local address 127.0.0.1:49450)
0810 03:15:33.222203 (+ 1956us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.222242 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.223448 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.236428 (+ 12980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.236436 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.236468 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.236922 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.236935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.241848 (+ 4913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.241854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.244445 (+ 2591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.244461 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.247047 (+ 2586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.247054 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.247268 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.247359 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.247507 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.247695 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1684,"mutex_wait_us":20,"thread_start_us":2146,"threads_started":1}
I20260810 03:15:33.248234 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.220390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49450 (local address 127.18.112.66:43065)
0810 03:15:33.235756 (+ 15366us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.235768 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.235820 (+ 52us) server_negotiation.cc:407] Connection header received
0810 03:15:33.235926 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.235934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.236190 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.237126 (+ 936us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.237375 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.241691 (+ 4316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.244672 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.246797 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.247442 (+ 645us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.247690 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.247763 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.247949 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14142,"thread_start_us":13952,"threads_started":1}
I20260810 03:15:33.251694 6543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.221878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:41763 (local address 127.0.0.1:33052)
0810 03:15:33.238018 (+ 16140us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.238037 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.238158 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.240311 (+ 2153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.240317 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.240345 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.240782 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.240793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.243430 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.243436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.245835 (+ 2399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.245853 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.250911 (+ 5058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.250917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.251076 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.251107 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.251194 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.251311 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16021,"mutex_wait_us":4,"thread_start_us":16837,"threads_started":1}
I20260810 03:15:33.252718 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.222224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.18.112.67:41763)
0810 03:15:33.239279 (+ 17055us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.239287 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.239318 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:15:33.239423 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.239431 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.239653 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.239981 (+ 328us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.241027 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.243261 (+ 2234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.246033 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.250396 (+ 4363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.250515 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.250758 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.252224 (+ 1466us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.252380 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16894,"thread_start_us":16760,"threads_started":1}
I20260810 03:15:33.252933 6209 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd13ab399e04cbe841225d053b32c37 (DEFAULT_TABLE table=test-table [id=e8d2c534416b4f2d9986b8948db32c5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:33.256562 6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd13ab399e04cbe841225d053b32c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:33.256597 6405 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd13ab399e04cbe841225d053b32c37 (DEFAULT_TABLE table=test-table [id=e8d2c534416b4f2d9986b8948db32c5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:33.257973 6405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd13ab399e04cbe841225d053b32c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:33.273590 6545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.223226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44405 (local address 127.0.0.1:33272)
0810 03:15:33.246152 (+ 22926us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.246170 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.246291 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.247088 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.247092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.247117 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.249454 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.249513 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.259469 (+ 9956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.259474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.270342 (+ 10868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.270359 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.272689 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.272695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.272880 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.272919 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.273007 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.273157 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22814,"mutex_wait_us":1,"thread_start_us":20397,"threads_started":1}
I20260810 03:15:33.274415 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.223835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.18.112.65:44405)
0810 03:15:33.238667 (+ 14832us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.238675 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.246260 (+ 7585us) server_negotiation.cc:407] Connection header received
0810 03:15:33.246428 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.246435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.246657 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.246847 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.254110 (+ 7263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.255728 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.270568 (+ 14840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.272134 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.272246 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.272470 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.273882 (+ 1412us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.274076 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14661,"thread_start_us":14514,"threads_started":1}
I20260810 03:15:33.278234 5974 tablet_service.cc:1467] Processing CreateTablet for tablet 4dd13ab399e04cbe841225d053b32c37 (DEFAULT_TABLE table=test-table [id=e8d2c534416b4f2d9986b8948db32c5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:33.279765 5974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dd13ab399e04cbe841225d053b32c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:33.279742 6547 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Bootstrap starting.
I20260810 03:15:33.285162 6547 tablet_bootstrap.cc:654] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:33.286477 6547 log.cc:824] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:33.295763 6547 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: No bootstrap required, opened a new log
I20260810 03:15:33.296221 6547 ts_tablet_manager.cc:1397] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20260810 03:15:33.306634 6547 raft_consensus.cc:348] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.308974 6552 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Bootstrap starting.
I20260810 03:15:33.307765 6549 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Bootstrap starting.
I20260810 03:15:33.312736 6552 tablet_bootstrap.cc:654] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:33.312752 6549 tablet_bootstrap.cc:654] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:33.314015 6549 log.cc:824] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:33.314015 6552 log.cc:824] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:33.314651 6547 raft_consensus.cc:374] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:33.314776 6547 raft_consensus.cc:729] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca351a589b74ee99a3ce41460cd510b, State: Initialized, Role: FOLLOWER
I20260810 03:15:33.315439 6547 consensus_queue.cc:260] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.326018 6547 ts_tablet_manager.cc:1428] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Time spent starting tablet: real 0.030s user 0.013s sys 0.004s
I20260810 03:15:33.326478 6503 heartbeater.cc:503] Master 127.18.112.126:35017 was elected leader, sending a full tablet report...
I20260810 03:15:33.328841 6552 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: No bootstrap required, opened a new log
I20260810 03:15:33.329187 6552 ts_tablet_manager.cc:1397] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.006s
I20260810 03:15:33.331410 6549 tablet_bootstrap.cc:492] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: No bootstrap required, opened a new log
I20260810 03:15:33.333354 6549 ts_tablet_manager.cc:1397] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.004s
I20260810 03:15:33.339851 6552 raft_consensus.cc:348] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.340349 6552 raft_consensus.cc:374] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:33.340482 6552 raft_consensus.cc:729] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d626ad13d4c446df8ad3525d682551b5, State: Initialized, Role: FOLLOWER
I20260810 03:15:33.341219 6552 consensus_queue.cc:260] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.344373 6549 raft_consensus.cc:348] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.344911 6549 raft_consensus.cc:374] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:33.345084 6549 raft_consensus.cc:729] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3932c766d13408fa47cf8c0a6385e8f, State: Initialized, Role: FOLLOWER
I20260810 03:15:33.345850 6549 consensus_queue.cc:260] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.349357 6080 heartbeater.cc:503] Master 127.18.112.126:35017 was elected leader, sending a full tablet report...
I20260810 03:15:33.349680 6552 ts_tablet_manager.cc:1428] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Time spent starting tablet: real 0.020s user 0.012s sys 0.007s
I20260810 03:15:33.352825 6549 ts_tablet_manager.cc:1428] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Time spent starting tablet: real 0.019s user 0.009s sys 0.006s
I20260810 03:15:33.400197 6559 raft_consensus.cc:482] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:15:33.400563 6559 raft_consensus.cc:504] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.411001 6559 leader_election.cc:288] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405), 7ca351a589b74ee99a3ce41460cd510b (127.18.112.67:41763)
I20260810 03:15:33.412813 6556 raft_consensus.cc:482] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:15:33.413105 6556 raft_consensus.cc:504] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.415149 6556 leader_election.cc:288] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3932c766d13408fa47cf8c0a6385e8f (127.18.112.66:43065), d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405)
I20260810 03:15:33.423346 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.415311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:43065 (local address 127.18.112.67:56397)
0810 03:15:33.415476 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.415495 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.415620 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.416893 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.416898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.416928 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.417128 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.417140 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.418550 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.418556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.420651 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.420668 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.422576 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.422582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.422788 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.422824 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.422917 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.423065 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 03:15:33.424026 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.416259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:56397 (local address 127.18.112.66:43065)
0810 03:15:33.416461 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.416467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.416486 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:15:33.416551 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.416556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.416637 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.416725 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.417303 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.418370 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.420858 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.422199 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.422354 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.422428 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.423630 (+ 1202us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.423765 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260810 03:15:33.425917 6237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "7ca351a589b74ee99a3ce41460cd510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3932c766d13408fa47cf8c0a6385e8f" is_pre_election: true
I20260810 03:15:33.426405 6237 raft_consensus.cc:2454] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca351a589b74ee99a3ce41460cd510b in term 0.
I20260810 03:15:33.427191 6332 leader_election.cc:302] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca351a589b74ee99a3ce41460cd510b, c3932c766d13408fa47cf8c0a6385e8f; no voters:
I20260810 03:15:33.427610 6556 raft_consensus.cc:2781] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:15:33.427742 6556 raft_consensus.cc:482] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:15:33.427953 6556 raft_consensus.cc:3037] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:33.431185 6556 raft_consensus.cc:504] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.432675 6237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "7ca351a589b74ee99a3ce41460cd510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3932c766d13408fa47cf8c0a6385e8f"
I20260810 03:15:33.432868 6237 raft_consensus.cc:3037] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:33.433868 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.403412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:54951 (local address 127.18.112.65:44405)
0810 03:15:33.403611 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.403617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.415436 (+ 11819us) server_negotiation.cc:407] Connection header received
0810 03:15:33.426999 (+ 11563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.427004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.427078 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.427135 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.427828 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.428857 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.431390 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.432688 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.432815 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.432882 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.433506 (+ 624us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.433638 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:15:33.434645 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.402957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44405 (local address 127.18.112.66:54951)
0810 03:15:33.415311 (+ 12354us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.415339 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.425646 (+ 10307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.427305 (+ 1659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.427310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.427336 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.427648 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.427660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.429042 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.429047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.431210 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.431225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.433132 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.433143 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.433318 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.433354 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.434095 (+ 741us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.434232 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12220,"thread_start_us":12489,"threads_started":1}
I20260810 03:15:33.435564 6014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "c3932c766d13408fa47cf8c0a6385e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d626ad13d4c446df8ad3525d682551b5" is_pre_election: true
I20260810 03:15:33.436156 6014 raft_consensus.cc:2454] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3932c766d13408fa47cf8c0a6385e8f in term 0.
I20260810 03:15:33.432036 6556 leader_election.cc:288] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [CANDIDATE]: Term 1 election: Requested vote from peers c3932c766d13408fa47cf8c0a6385e8f (127.18.112.66:43065), d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405)
I20260810 03:15:33.436990 6237 raft_consensus.cc:2454] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca351a589b74ee99a3ce41460cd510b in term 1.
I20260810 03:15:33.437165 6126 leader_election.cc:302] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3932c766d13408fa47cf8c0a6385e8f, d626ad13d4c446df8ad3525d682551b5; no voters:
I20260810 03:15:33.437526 6332 leader_election.cc:302] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca351a589b74ee99a3ce41460cd510b, c3932c766d13408fa47cf8c0a6385e8f; no voters:
I20260810 03:15:33.437877 6556 raft_consensus.cc:2781] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:33.444432 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.403762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:56423 (local address 127.18.112.67:41763)
0810 03:15:33.403943 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.403948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.437966 (+ 34018us) server_negotiation.cc:407] Connection header received
0810 03:15:33.438196 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.438201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.438266 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.438316 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.438819 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.439912 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.442128 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.443315 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.443434 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.443501 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.444082 (+ 581us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.444210 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 03:15:33.444900 6081 tablet.cc:2369] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:33.444965 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.402982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:41763 (local address 127.18.112.66:56423)
0810 03:15:33.437885 (+ 34903us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.437902 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.438065 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.438490 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.438495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.438519 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.438670 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.438679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.440139 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.440145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.441930 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.441945 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.443679 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.443685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.443887 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.443919 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.444592 (+ 673us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.444725 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34796,"threads_started":1}
I20260810 03:15:33.448107 6559 raft_consensus.cc:2741] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 03:15:33.454443 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.415686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44405 (local address 127.18.112.67:55247)
0810 03:15:33.424399 (+ 8713us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:33.424417 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:33.424517 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:33.436139 (+ 11622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:33.436144 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:33.436174 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:33.436582 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.436596 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.446883 (+ 10287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.446888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.448729 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:33.448744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.453702 (+ 4958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.453707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:33.453903 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.453934 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:15:33.454010 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 03:15:33.454148 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8612,"thread_start_us":9170,"threads_started":1}
W20260810 03:15:33.454818 6509 tablet.cc:2369] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:33.456396 6566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.415766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:55247 (local address 127.18.112.65:44405)
0810 03:15:33.426370 (+ 10604us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.426375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.426398 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:15:33.426462 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.426467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.426537 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.426630 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:33.445409 (+ 18779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.446744 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.448918 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.453359 (+ 4441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.453525 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.453591 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.455963 (+ 2372us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.456113 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10457,"thread_start_us":11015,"threads_started":1}
I20260810 03:15:33.457851 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "c3932c766d13408fa47cf8c0a6385e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca351a589b74ee99a3ce41460cd510b" is_pre_election: true
I20260810 03:15:33.459124 6014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "7ca351a589b74ee99a3ce41460cd510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d626ad13d4c446df8ad3525d682551b5" is_pre_election: true
I20260810 03:15:33.459352 6014 raft_consensus.cc:2454] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca351a589b74ee99a3ce41460cd510b in term 0.
I20260810 03:15:33.459939 6014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dd13ab399e04cbe841225d053b32c37" candidate_uuid: "7ca351a589b74ee99a3ce41460cd510b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d626ad13d4c446df8ad3525d682551b5"
I20260810 03:15:33.460141 6014 raft_consensus.cc:3037] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:33.463768 6014 raft_consensus.cc:2454] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca351a589b74ee99a3ce41460cd510b in term 1.
I20260810 03:15:33.467268 6556 raft_consensus.cc:686] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 1 LEADER]: Becoming Leader. State: Replica: 7ca351a589b74ee99a3ce41460cd510b, State: Running, Role: LEADER
I20260810 03:15:33.467859 6556 consensus_queue.cc:237] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } }
I20260810 03:15:33.474613 5778 catalog_manager.cc:5495] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca351a589b74ee99a3ce41460cd510b (127.18.112.67). New cstate: current_term: 1 leader_uuid: "7ca351a589b74ee99a3ce41460cd510b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ca351a589b74ee99a3ce41460cd510b" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260810 03:15:33.524693 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.517349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33066 (local address 127.18.112.67:41763)
0810 03:15:33.517527 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.517534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.517699 (+ 165us) server_negotiation.cc:407] Connection header received
0810 03:15:33.517944 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.517950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.518086 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.518238 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:15:33.518678 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.519837 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.521813 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.522418 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.522547 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.523157 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:15:33.523978 (+ 821us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:15:33.524217 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.524273 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.524361 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:15:33.534459 6014 raft_consensus.cc:1261] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 1 FOLLOWER]: Refusing update from remote peer 7ca351a589b74ee99a3ce41460cd510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:33.534776 6237 raft_consensus.cc:1261] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 1 FOLLOWER]: Refusing update from remote peer 7ca351a589b74ee99a3ce41460cd510b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:33.535856 6556 consensus_queue.cc:1035] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3932c766d13408fa47cf8c0a6385e8f" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:33.536507 6569 consensus_queue.cc:1035] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d626ad13d4c446df8ad3525d682551b5" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:33.561348 6573 mvcc.cc:205] Tried to move back new op lower bound from 7316814780545994752 to 7316814780288974848. Current Snapshot: MvccSnapshot[applied={T|T < 7316814780545994752}]
W20260810 03:15:33.569590 6297 tablet.cc:2369] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:33.575971 6574 mvcc.cc:205] Tried to move back new op lower bound from 7316814780545994752 to 7316814780288974848. Current Snapshot: MvccSnapshot[applied={T|T < 7316814780545994752}]
I20260810 03:15:33.580734 5778 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:33.580998 5778 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:33.585134 5778 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec12cc3dc2e4496a84c152d868d6febd: Sending DeleteTablet for 3 replicas of tablet 4dd13ab399e04cbe841225d053b32c37
I20260810 03:15:33.586205 6209 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd13ab399e04cbe841225d053b32c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:33 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:49450
I20260810 03:15:33.588089 5974 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd13ab399e04cbe841225d053b32c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:33 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33272
I20260810 03:15:33.588212 6405 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dd13ab399e04cbe841225d053b32c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:33 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:33052
I20260810 03:15:33.597263 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 5841
I20260810 03:15:33.600485 6590 tablet_replica.cc:330] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: stopping tablet replica
I20260810 03:15:33.601064 6590 raft_consensus.cc:2229] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:33.601666 6590 raft_consensus.cc:2258] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:33.603771 6590 ts_tablet_manager.cc:1905] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:33.610671 6590 ts_tablet_manager.cc:1918] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:33.610936 6590 log.cc:1196] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/4dd13ab399e04cbe841225d053b32c37
I20260810 03:15:33.611578 6590 ts_tablet_manager.cc:1939] T 4dd13ab399e04cbe841225d053b32c37 P d626ad13d4c446df8ad3525d682551b5: Deleting consensus metadata
I20260810 03:15:33.613384 5757 catalog_manager.cc:4841] TS d626ad13d4c446df8ad3525d682551b5 (127.18.112.65:44405): tablet 4dd13ab399e04cbe841225d053b32c37 (table test-table [id=e8d2c534416b4f2d9986b8948db32c5e]) successfully deleted
I20260810 03:15:33.616962 6592 tablet_replica.cc:330] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: stopping tablet replica
I20260810 03:15:33.617465 6592 raft_consensus.cc:2229] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:15:33.618392 6592 raft_consensus.cc:2258] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:33.620409 6589 tablet_replica.cc:330] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: stopping tablet replica
I20260810 03:15:33.621749 6592 ts_tablet_manager.cc:1905] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:33.622262 6589 raft_consensus.cc:2229] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:33.622812 6589 raft_consensus.cc:2258] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:33.624822 6589 ts_tablet_manager.cc:1905] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:33.631551 6589 ts_tablet_manager.cc:1918] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:33.631771 6589 log.cc:1196] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/4dd13ab399e04cbe841225d053b32c37
I20260810 03:15:33.632431 6589 ts_tablet_manager.cc:1939] T 4dd13ab399e04cbe841225d053b32c37 P c3932c766d13408fa47cf8c0a6385e8f: Deleting consensus metadata
I20260810 03:15:33.634229 5757 catalog_manager.cc:4841] TS c3932c766d13408fa47cf8c0a6385e8f (127.18.112.66:43065): tablet 4dd13ab399e04cbe841225d053b32c37 (table test-table [id=e8d2c534416b4f2d9986b8948db32c5e]) successfully deleted
I20260810 03:15:33.634701 6566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.598704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33288 (local address 127.18.112.65:44405)
0810 03:15:33.598906 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.598912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.616334 (+ 17422us) server_negotiation.cc:407] Connection header received
0810 03:15:33.616533 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.616539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.616621 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.616716 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:33.618769 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.619858 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.621846 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.622424 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.622536 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.626281 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:33.626296 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:33.626315 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:33.626355 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:33.630651 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.631661 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.631670 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.631674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.631879 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.632475 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.632481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.632484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.632949 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:33.633222 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.633866 (+ 644us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.634115 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:15:33.636379 6070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:33.638273 6592 ts_tablet_manager.cc:1918] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:33.638754 6592 log.cc:1196] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/4dd13ab399e04cbe841225d053b32c37
I20260810 03:15:33.639925 6592 ts_tablet_manager.cc:1939] T 4dd13ab399e04cbe841225d053b32c37 P 7ca351a589b74ee99a3ce41460cd510b: Deleting consensus metadata
I20260810 03:15:33.642416 5759 catalog_manager.cc:4841] TS 7ca351a589b74ee99a3ce41460cd510b (127.18.112.67:41763): tablet 4dd13ab399e04cbe841225d053b32c37 (table test-table [id=e8d2c534416b4f2d9986b8948db32c5e]) successfully deleted
I20260810 03:15:33.735757 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 5841
I20260810 03:15:33.760982 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 6084
I20260810 03:15:33.775426 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.762323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.18.112.66:43065)
0810 03:15:33.762582 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.762588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.762609 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:15:33.762805 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.762811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.762883 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.762998 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:33.764402 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.765137 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.766439 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.766860 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.766971 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.769584 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:33.769597 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:33.769613 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:33.769650 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:33.772692 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.773358 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.773368 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.773372 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.773505 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.773900 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.773904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.773906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.774259 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:33.774567 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.774860 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.775072 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260810 03:15:33.776077 6289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:33.887025 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 6084
I20260810 03:15:33.915311 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 6302
I20260810 03:15:33.929446 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:33.916077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33072 (local address 127.18.112.67:41763)
0810 03:15:33.916651 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:33.916656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:33.916671 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:15:33.916724 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:33.916728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:33.916789 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:33.916873 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:33.918244 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.919014 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.920572 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:33.921002 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:33.921127 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:33.923623 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:33.923635 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:33.923650 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:33.923690 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:33.926748 (+ 3058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.927384 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.927396 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.927398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.927525 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:33.927927 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:33.927931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:33.927933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:33.928334 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:33.928662 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:33.928900 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 03:15:33.929118 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438}
I20260810 03:15:33.930145 6494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:34.047907 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 6302
I20260810 03:15:34.072935 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 5735
I20260810 03:15:34.074091 5830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:34.184379 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 5735
I20260810 03:15:34.210942 18881 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 03:15:34.554448 18881 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 03:15:34.554639 18881 mini_ranger.cc:66] Stopping Ranger...
I20260810 03:15:34.898168 18881 mini_ranger.cc:68] Stopped Ranger
2026-08-10 03:15:34.898 UTC [4313] LOG: received smart shutdown request
2026-08-10 03:15:34.901 UTC [4313] LOG: background worker "logical replication launcher" (PID 4325) exited with exit code 1
2026-08-10 03:15:34.901 UTC [4319] LOG: shutting down
2026-08-10 03:15:35.028 UTC [4313] LOG: database system is shut down
2026-08-10T03:15:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52536 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:15:35 dist-test-slave-jlzn krb5kdc[6613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:15:35 dist-test-slave-jlzn krb5kdc[6613](info): set up 2 sockets
Aug 10 03:15:35 dist-test-slave-jlzn krb5kdc[6613](info): commencing operation
krb5kdc: starting...
W20260810 03:15:36.311045 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:15:36 dist-test-slave-jlzn krb5kdc[6613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:15:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:15:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:15:36.521067 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44777
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:39965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:36.842029 6630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:36.842298 6630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:36.842430 6630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:36.849396 6630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:36.849534 6630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:36.849611 6630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:36.849691 6630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:36.849752 6630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:36.859206 6630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:39965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:36.860426 6630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:36.861662 6630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:36.876441 6637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:36.876483 6640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:36.876504 6642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:36.877115 6630 server_base.cc:1034] running on GCE node
I20260810 03:15:36.877810 6630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:36.879022 6630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:36.880221 6630 hybrid_clock.cc:648] HybridClock initialized: now 1786331736880181 us; error 30 us; skew 500 ppm
I20260810 03:15:36.880544 6630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:36 dist-test-slave-jlzn krb5kdc[6613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:36.888118 6630 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:36.889431 6630 webserver.cc:460] Webserver started at http://127.18.112.126:39319/ using document root <none> and password file <none>
I20260810 03:15:36.890046 6630 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:36.890175 6630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:36.890465 6630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:36.893276 6630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "059812ce538e4db5bdef4940ca5621c2"
format_stamp: "Formatted at 2026-08-10 03:15:36 on dist-test-slave-jlzn"
server_key: "8b70b59610c383bf4403bcfa0a8856d5"
server_key_iv: "148f0e7e59606b93f33fb831c601632c"
server_key_version: "encryptionkey@0"
I20260810 03:15:36.894023 6630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "059812ce538e4db5bdef4940ca5621c2"
format_stamp: "Formatted at 2026-08-10 03:15:36 on dist-test-slave-jlzn"
server_key: "8b70b59610c383bf4403bcfa0a8856d5"
server_key_iv: "148f0e7e59606b93f33fb831c601632c"
server_key_version: "encryptionkey@0"
I20260810 03:15:36.899003 6630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 03:15:36.902269 6651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:36.903440 6630 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:15:36.903591 6630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "059812ce538e4db5bdef4940ca5621c2"
format_stamp: "Formatted at 2026-08-10 03:15:36 on dist-test-slave-jlzn"
server_key: "8b70b59610c383bf4403bcfa0a8856d5"
server_key_iv: "148f0e7e59606b93f33fb831c601632c"
server_key_version: "encryptionkey@0"
I20260810 03:15:36.903767 6630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:36.930971 6630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:36.934494 6630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:36.934752 6630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:36.951448 6630 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44777
I20260810 03:15:36.951484 6726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44777 every 8 connection(s)
I20260810 03:15:36.952657 6630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:36.955950 6727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:36.961184 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 6630
I20260810 03:15:36.961417 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:15:36.962210 18881 external_mini_cluster.cc:1428] Setting key a15a9fbc3ae9a9956e2996d020a27cff
I20260810 03:15:36.962488 6727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:15:36 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:36.983424 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:36.965825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60668 (local address 127.18.112.126:44777)
0810 03:15:36.967354 (+ 1529us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:36.967366 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:36.967415 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:15:36.968943 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:36.968949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:36.969158 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:36.969326 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:36.970498 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:36.971824 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:36.973291 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:36.973817 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:36.973984 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:36.976970 (+ 2986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:36.976978 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:36.976989 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:36.977015 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:36.979473 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:36.980152 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:36.980158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:36.980161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:36.980294 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:36.980654 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:36.980658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:36.980660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:36.981117 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:36.981304 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:36.981889 (+ 585us) server_negotiation.cc:299] Negotiation successful
0810 03:15:36.982115 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1325,"spinlock_wait_cycles":15104,"thread_start_us":1129,"threads_started":1}
I20260810 03:15:36.983459 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:36.965824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44777 (local address 127.0.0.1:60668)
0810 03:15:36.966683 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:36.966728 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:36.968611 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:36.969370 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:36.969377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:36.970008 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:36.970316 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:36.970333 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:36.971989 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:36.971996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:36.973154 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:36.973167 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:36.974031 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:36.974038 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:36.974206 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:36.974744 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:36.974767 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:36.976767 (+ 2000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:36.979594 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:36.979604 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:36.979615 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:36.980030 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:36.980397 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:36.980401 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:36.980405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:36.980548 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:36.981254 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:36.981261 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:36.981471 (+ 210us) client_negotiation.cc:769] Sending connection context
0810 03:15:36.981713 (+ 242us) client_negotiation.cc:240] Negotiation successful
0810 03:15:36.982268 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":138,"thread_start_us":359,"threads_started":1}
WARNING: no policy specified for kudu/127.18.112.125@KRBTEST.COM; defaulting to no policy
I20260810 03:15:36.986121 6727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:15:36.986996 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:36.986651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35176)
0810 03:15:36.986797 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:36.986896 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 03:15:36.987208 6656 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.125@KRBTEST.COM" created.
I20260810 03:15:36.988667 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:36.988301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35182)
0810 03:15:36.988437 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:36.988518 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:15:36.988850 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:44595: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
I20260810 03:15:37.013005 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:44595
--webserver_interface=127.18.112.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:39965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:37.038234 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } attempt: 1
I20260810 03:15:37.039229 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.038829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35196)
0810 03:15:37.038990 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.039102 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:15:37.040143 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.039827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35210)
0810 03:15:37.039948 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.040012 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 03:15:37.040305 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:44595: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
I20260810 03:15:37.108494 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } attempt: 2
I20260810 03:15:37.109539 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.109114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35220)
0810 03:15:37.109322 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.109408 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 03:15:37.110450 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.110121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35222)
0810 03:15:37.110255 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.110320 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:15:37.110634 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:44595: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
I20260810 03:15:37.201848 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } attempt: 3
I20260810 03:15:37.202979 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.202568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35236)
0810 03:15:37.202746 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.202851 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 03:15:37.203987 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.203646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35238)
0810 03:15:37.203758 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.203851 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 03:15:37.204171 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:44595: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
W20260810 03:15:37.322321 6738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:37.322577 6738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:37.322714 6738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:37.329509 6738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:37.329600 6738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:37.329682 6738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:37.329758 6738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:37.329820 6738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:37.338887 6738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:39965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:44595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.112.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:37.339998 6738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:37.341115 6738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:15:37.347364 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } attempt: 4
I20260810 03:15:37.348515 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.347991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35252)
0810 03:15:37.348297 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.348382 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260810 03:15:37.349416 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.349103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35266)
0810 03:15:37.349216 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.349302 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 03:15:37.349617 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:44595: Network error: Client connection negotiation failed: client connection to 127.18.112.125:44595: connect: Connection refused (error 111)
W20260810 03:15:37.352001 6746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:37.352042 6750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:37.352087 6747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:37.353084 6738 server_base.cc:1034] running on GCE node
I20260810 03:15:37.353780 6738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:37.354956 6738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:37.356149 6738 hybrid_clock.cc:648] HybridClock initialized: now 1786331737356099 us; error 40 us; skew 500 ppm
I20260810 03:15:37.356462 6738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:37.359401 6738 init.cc:377] Logged in from keytab as kudu/127.18.112.125@KRBTEST.COM (short username kudu)
I20260810 03:15:37.360749 6738 webserver.cc:460] Webserver started at http://127.18.112.125:39815/ using document root <none> and password file <none>
I20260810 03:15:37.361366 6738 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:37.361479 6738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:37.361758 6738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:37.364589 6738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data/instance:
uuid: "2535048d01d041be8da3893f36d0a48b"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "c716aea1fbedeaba05c8ed1b2b78cefa"
server_key_iv: "018bb3ba507e431230d02ea77ae53196"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.365339 6738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal/instance:
uuid: "2535048d01d041be8da3893f36d0a48b"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "c716aea1fbedeaba05c8ed1b2b78cefa"
server_key_iv: "018bb3ba507e431230d02ea77ae53196"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.370055 6738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:15:37.373196 6760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:37.374339 6738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:15:37.374496 6738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "2535048d01d041be8da3893f36d0a48b"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "c716aea1fbedeaba05c8ed1b2b78cefa"
server_key_iv: "018bb3ba507e431230d02ea77ae53196"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.374666 6738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:37.385625 6738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:37.389422 6738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:37.389665 6738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:37.405969 6738 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.125:44595
I20260810 03:15:37.406006 6844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.125:44595 every 8 connection(s)
I20260810 03:15:37.407202 6738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
I20260810 03:15:37.410497 6846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:37.410574 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 6738
I20260810 03:15:37.410778 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-1/wal/instance
I20260810 03:15:37.411181 18881 external_mini_cluster.cc:1428] Setting key ed3c848bd1c7c0902fe2c7310152e4d0
I20260810 03:15:37.416512 6846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.112.124@KRBTEST.COM; defaulting to no policy
I20260810 03:15:37.434919 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.418809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60670 (local address 127.18.112.126:44777)
0810 03:15:37.418965 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.418970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.420100 (+ 1130us) server_negotiation.cc:407] Connection header received
0810 03:15:37.421820 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.421827 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.421906 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.421995 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.423722 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.424435 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.425880 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.426291 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.426400 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.429517 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.429523 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.429528 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.429567 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.432304 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.432958 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.432963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.432965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.433086 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.433462 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.433467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.433469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.433765 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.433898 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.434530 (+ 632us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.434700 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:15:37.435781 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.419270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44777 (local address 127.0.0.1:60670)
0810 03:15:37.419967 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.420002 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.421563 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.422223 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.422231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.422888 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.423537 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.423555 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.424585 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.424590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.425742 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.425755 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.426492 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.426500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.426703 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.427268 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.427289 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.429295 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.432436 (+ 3141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.432445 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.432457 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.432847 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.433192 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.433197 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.433199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.433356 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.433888 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.433895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.434183 (+ 288us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.434422 (+ 239us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.434765 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":282,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.124@KRBTEST.COM" created.
I20260810 03:15:37.437521 6846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:15:37.450876 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.438242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35270)
0810 03:15:37.438400 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.438418 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.438516 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.439191 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.439195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.439584 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.439760 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.439770 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.441045 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.441049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.442186 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.442200 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.442934 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.442939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.443120 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.443597 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.443617 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.445904 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.448703 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.448708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.448712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.449018 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.449357 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.449362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.449365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.449510 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.450028 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.450032 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.450165 (+ 133us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.450277 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.450516 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:15:37.451121 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.438297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35270 (local address 127.18.112.125:44595)
0810 03:15:37.438828 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.438833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.438857 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:15:37.438897 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.438902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.439047 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.439158 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.439913 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.440911 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.442311 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.442795 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.442881 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.446082 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.446092 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.446102 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.446146 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.448582 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.449142 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.449148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.449150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.449258 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.449604 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.449608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.449611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.449909 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.450083 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.450442 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.450634 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":247,"threads_started":1}
I20260810 03:15:37.453378 6846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:15:37.454324 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.453932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46444)
0810 03:15:37.454082 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.454181 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 03:15:37.454569 6767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.456022 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.455701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46456)
0810 03:15:37.455856 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.455930 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:15:37.456228 6846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
I20260810 03:15:37.464160 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:39433
--webserver_interface=127.18.112.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:39965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:37.505476 6846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 1
I20260810 03:15:37.506451 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.506058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46468)
0810 03:15:37.506233 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.506322 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 03:15:37.507344 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.507004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46474)
0810 03:15:37.507155 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.507235 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 03:15:37.507520 6846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.575703 6846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 2
I20260810 03:15:37.576661 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.576250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46484)
0810 03:15:37.576430 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.576516 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 03:15:37.577551 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.577230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46492)
0810 03:15:37.577368 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.577432 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:15:37.577749 6846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.648860 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } attempt: 5
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:15:37.663388 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.649571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35278)
0810 03:15:37.649795 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.649818 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.649951 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.650320 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.650324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.650713 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.650889 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.650898 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.651929 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.651936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.653386 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.653405 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.654158 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.654165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.654370 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.654991 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.655016 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.657444 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.661289 (+ 3845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.661293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.661296 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.661634 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.662003 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.662006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.662008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.662125 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.662697 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.662700 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.662817 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.662932 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.663160 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 03:15:37.663594 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.649745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35278 (local address 127.18.112.125:44595)
0810 03:15:37.649920 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.649925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.649947 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:15:37.650080 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.650086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.650175 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.650263 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.651060 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.651765 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.653528 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.653976 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.654067 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.657657 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.657665 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.657670 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.657716 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.661147 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.661749 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.661755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.661759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.661911 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.662230 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.662234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.662238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.662600 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.662753 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.663057 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.663289 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:15:37.664561 6727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:15:37.665465 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.665147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46504)
0810 03:15:37.665278 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.665349 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 03:15:37.666357 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.666050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46516)
0810 03:15:37.666203 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.666262 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 03:15:37.666528 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.668926 6846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 3
I20260810 03:15:37.669759 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.669429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46532)
0810 03:15:37.669565 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.669635 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:15:37.670624 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.670249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46546)
0810 03:15:37.670451 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.670521 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260810 03:15:37.670852 6846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.717715 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 1
I20260810 03:15:37.718739 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.718326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46554)
0810 03:15:37.718495 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.718585 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 03:15:37.719651 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.719349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46562)
0810 03:15:37.719471 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.719536 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:15:37.719870 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
W20260810 03:15:37.777199 6856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:37.777441 6856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:37.777539 6856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:37.784418 6856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:37.784507 6856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:37.784564 6856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:37.784618 6856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:37.784662 6856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:37.788050 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 2
I20260810 03:15:37.789060 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.788647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46572)
0810 03:15:37.788823 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.788908 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 03:15:37.789964 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.789651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46582)
0810 03:15:37.789794 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.789862 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 03:15:37.790148 6727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.794093 6856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:39965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44777,127.18.112.125:44595,127.18.112.124:39433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:39433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.112.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:37.795238 6856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:37.796427 6856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:37.807053 6862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:37.807109 6864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:37.807075 6867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:37.807937 6856 server_base.cc:1034] running on GCE node
I20260810 03:15:37.808666 6856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:37.809851 6856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:37.811048 6856 hybrid_clock.cc:648] HybridClock initialized: now 1786331737810999 us; error 36 us; skew 500 ppm
I20260810 03:15:37.811339 6856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:37.814038 6846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 4
I20260810 03:15:37.814154 6856 init.cc:377] Logged in from keytab as kudu/127.18.112.124@KRBTEST.COM (short username kudu)
I20260810 03:15:37.815016 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.814539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46584)
0810 03:15:37.814804 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.814879 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260810 03:15:37.815644 6856 webserver.cc:460] Webserver started at http://127.18.112.124:40639/ using document root <none> and password file <none>
I20260810 03:15:37.816016 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.815678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46598)
0810 03:15:37.815840 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.815916 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:15:37.816200 6846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39433: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39433: connect: Connection refused (error 111)
I20260810 03:15:37.816371 6856 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:37.816485 6856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:37.816761 6856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:37.819450 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data/instance:
uuid: "e1194e4700784b27b2af70a01f009e6d"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "b803d2116ae0cc0e9e15a3e633a2212f"
server_key_iv: "7dd8f831d93129f25b105033eeabae20"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.820225 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal/instance:
uuid: "e1194e4700784b27b2af70a01f009e6d"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "b803d2116ae0cc0e9e15a3e633a2212f"
server_key_iv: "7dd8f831d93129f25b105033eeabae20"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.824759 6856 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:15:37.827759 6877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:37.828923 6856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:15:37.829085 6856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "e1194e4700784b27b2af70a01f009e6d"
format_stamp: "Formatted at 2026-08-10 03:15:37 on dist-test-slave-jlzn"
server_key: "b803d2116ae0cc0e9e15a3e633a2212f"
server_key_iv: "7dd8f831d93129f25b105033eeabae20"
server_key_version: "encryptionkey@0"
I20260810 03:15:37.829255 6856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:37.840133 6856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:37.843436 6856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:37.843672 6856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:37.859756 6856 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.124:39433
I20260810 03:15:37.859790 6954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.124:39433 every 8 connection(s)
I20260810 03:15:37.860952 6856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
I20260810 03:15:37.862890 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 6856
I20260810 03:15:37.863075 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786331536832683-18881-0/minicluster-data/master-2/wal/instance
I20260810 03:15:37.863641 18881 external_mini_cluster.cc:1428] Setting key 9229f83b40cae624b43f89cc19880b05
I20260810 03:15:37.864451 6956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:37.873354 6956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:37.885330 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.865257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46602 (local address 127.18.112.124:39433)
0810 03:15:37.866047 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.866058 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.866096 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:15:37.867580 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.867600 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.868003 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.868312 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.870039 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.871460 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.873398 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.874039 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.874197 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.878452 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.878462 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.878474 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.878512 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.881727 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.882369 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.882377 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.882384 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.882590 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.882966 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.882969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.882971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.883566 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.883887 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.884184 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.884436 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":376,"threads_started":1}
I20260810 03:15:37.889961 6965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.875697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44777 (local address 127.0.0.1:60686)
0810 03:15:37.876347 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.876377 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.876518 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.876856 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.876862 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.877390 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.877648 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.877661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.878849 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.878853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.880001 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.880016 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.880737 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.880744 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.880906 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.881442 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.881468 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.883862 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.887044 (+ 3182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.887053 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.887058 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.887537 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.888489 (+ 952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.888494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.888497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.888652 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.889240 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.889245 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.889388 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.889518 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.889712 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":357,"threads_started":1}
I20260810 03:15:37.890213 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.875689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.18.112.126:44777)
0810 03:15:37.875878 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.875882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.876476 (+ 594us) server_negotiation.cc:407] Connection header received
0810 03:15:37.876628 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.876633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.876707 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.876787 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.877792 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.878698 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.880129 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.880552 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.880650 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.884061 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.884067 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.884072 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.884111 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.886916 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.887671 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.887676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.887679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.887850 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.888775 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.888779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.888781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.889116 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.889270 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.889680 (+ 410us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.889880 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:15:37.891381 6956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:37.896333 6727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 3
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:15:37.903959 6965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.892133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:44595 (local address 127.0.0.1:35294)
0810 03:15:37.892285 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.892299 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.892388 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.892676 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.892680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.892998 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.893123 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.893130 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.894024 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.894029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.894858 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.894869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.895530 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.895536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.895711 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.896206 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.896227 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.898493 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.901696 (+ 3203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.901701 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.901705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.902155 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.902510 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.902515 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.902519 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.902650 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.903097 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.903101 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.903247 (+ 146us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.903400 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.903634 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:15:37.904115 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.892046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35294 (local address 127.18.112.125:44595)
0810 03:15:37.892201 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.892207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.892355 (+ 148us) server_negotiation.cc:407] Connection header received
0810 03:15:37.892493 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.892498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.892562 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.892636 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.893261 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.893897 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.894989 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.895399 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.895502 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.898708 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.898714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.898719 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.898757 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.901582 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.902262 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.902268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.902271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.902408 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.902747 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.902752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.902756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.902987 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.903112 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.903511 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.903724 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 03:15:37.905135 6956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:15:37.906615 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.888045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60702 (local address 127.18.112.126:44777)
0810 03:15:37.888650 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.888656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.888679 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:15:37.888722 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.888727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.888790 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.888865 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.890324 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.891370 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.892810 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.893207 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.893310 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.897556 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.897563 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.897568 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.897606 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.901359 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.903039 (+ 1680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.903045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.903048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.903181 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.903612 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.903616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.903619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.904026 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.904284 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.905281 (+ 997us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.906303 (+ 1022us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":488,"thread_start_us":272,"threads_started":1}
I20260810 03:15:37.910423 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.896823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46608)
0810 03:15:37.896996 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.897014 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.897100 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.897456 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.897461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.897799 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.898004 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.898013 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.899205 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.899211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.900470 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.900486 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.901497 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.901502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.901672 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.902176 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.902193 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.904319 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.908034 (+ 3715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.908039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.908043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.908473 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.908928 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.908933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.908936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.909081 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.909556 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.909560 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.909688 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.909839 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.910073 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:15:37.910465 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.896876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46608 (local address 127.18.112.124:39433)
0810 03:15:37.897017 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.897031 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.897066 (+ 35us) server_negotiation.cc:407] Connection header received
0810 03:15:37.897234 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.897239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.897306 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.897390 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.898130 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.899075 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.900641 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.901229 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.901340 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.904504 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.904508 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.904511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.904546 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.907897 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.908620 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.908625 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.908629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.908780 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.909209 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.909213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.909215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.909440 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.909559 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.909952 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.910168 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:15:37.916139 6727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: Bootstrap starting.
Aug 10 03:15:37 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:15:37.919595 6727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:37.920320 6965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.905710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46612)
0810 03:15:37.905843 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:37.905858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:37.905936 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:37.907101 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:37.907105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:37.907718 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:37.907902 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.907916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.909404 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.909408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.910728 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:37.910742 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.911780 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.911785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:37.911958 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.912476 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:37.912503 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:37.914797 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:37.918155 (+ 3358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.918160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.918164 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.918473 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.918857 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:37.918861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:37.918863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:37.918978 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:37.919422 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:37.919426 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:37.919554 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 03:15:37.919688 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 03:15:37.919981 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 03:15:37.920542 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.905777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46612 (local address 127.18.112.124:39433)
0810 03:15:37.906602 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.906607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.906630 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:15:37.906687 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.906692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.906749 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.906858 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.908062 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.909266 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.910871 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.911470 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.911605 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.915014 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.915021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.915026 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.915061 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.918052 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.918580 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.918585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.918588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.918737 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.919080 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.919085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.919088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.919319 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.919435 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.919880 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.920124 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":697,"thread_start_us":507,"threads_started":1}
I20260810 03:15:37.920864 6727 log.cc:824] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:37.923864 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.908314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35300 (local address 127.18.112.125:44595)
0810 03:15:37.908477 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.908481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.908568 (+ 87us) server_negotiation.cc:407] Connection header received
0810 03:15:37.908721 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.908726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.908789 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.908882 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.910420 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.911438 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.912833 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.913256 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.913360 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.917934 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.917941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.917945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.917980 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.921567 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.922150 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.922155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.922159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.922305 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.922601 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.922605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.922608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.922903 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.923163 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.923283 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.923495 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:15:37.925333 6956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: Bootstrap starting.
I20260810 03:15:37.926364 6727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: No bootstrap required, opened a new log
I20260810 03:15:37.928175 6956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:37.929304 6956 log.cc:824] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:37.931250 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:15:37.936028 6727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:37.936391 6727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:37.936515 6727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059812ce538e4db5bdef4940ca5621c2, State: Initialized, Role: FOLLOWER
I20260810 03:15:37.937234 6727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:37.938117 6956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: No bootstrap required, opened a new log
I20260810 03:15:37.938267 6983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:37.938726 6983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:37.939515 6727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:37.957365 6956 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:37.959914 6956 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:37.961002 6956 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1194e4700784b27b2af70a01f009e6d, State: Initialized, Role: FOLLOWER
I20260810 03:15:37.966747 6956 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:37.971768 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.940899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35302 (local address 127.18.112.125:44595)
0810 03:15:37.941062 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.941067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.947863 (+ 6796us) server_negotiation.cc:407] Connection header received
0810 03:15:37.948349 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.948355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.948433 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.948499 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.950808 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.952015 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.954417 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.955076 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.955182 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.958876 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.958884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.958889 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.958933 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.962492 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.963404 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.963410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.963414 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.963582 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.964058 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.964064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.964067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.964465 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.964708 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.971106 (+ 6398us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.971379 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:15:37.975662 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.937291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60716 (local address 127.18.112.126:44777)
0810 03:15:37.937488 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.937493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.944440 (+ 6947us) server_negotiation.cc:407] Connection header received
0810 03:15:37.944686 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.944691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.944770 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.944837 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.951176 (+ 6339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.952252 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.954294 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.954967 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.955070 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.961771 (+ 6701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.961778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.961783 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.961824 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.965516 (+ 3692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.971928 (+ 6412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.971934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.971938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.972120 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.972917 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.972923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.972926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.973278 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.973518 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.975053 (+ 1535us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.975296 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:15:37.976452 6994 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:37.976845 6994 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:37.978668 6956 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:37.984447 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:37.947874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.18.112.124:39433)
0810 03:15:37.948078 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:37.948088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:37.965844 (+ 17756us) server_negotiation.cc:407] Connection header received
0810 03:15:37.965910 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:37.965916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:37.965990 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:37.966073 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:37.967967 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.969054 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.972324 (+ 3270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:37.973025 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:37.973121 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:37.978764 (+ 5643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:37.978771 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:37.978775 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:37.978819 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:37.981745 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.982578 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.982584 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.982587 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.982743 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:37.983180 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:37.983185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:37.983189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:37.983456 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:37.983689 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:37.983956 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 03:15:37.984151 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 03:15:37.993744 7008 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:15:37.993922 7008 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:15:37.992161 6630 master_runner.cc:186] Error getting master registration for 127.18.112.125:44595: OK, instance_id { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" instance_seqno: 1786331737401338 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:15:38.003093 6630 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 03:15:38.007120 7022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:15:38.007318 7022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:15:38.006669 6856 master_runner.cc:186] Error getting master registration for 127.18.112.125:44595: OK, instance_id { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" instance_seqno: 1786331737401338 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:15:38.014982 6856 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 03:15:38.095471 6884 tablet.cc:2369] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:38.115391 6846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } attempt: 5
Aug 10 03:15:38 dist-test-slave-jlzn krb5kdc[6613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331737, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:15:38.129153 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:38.116003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39433 (local address 127.0.0.1:46640)
0810 03:15:38.116234 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:38.116252 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:38.116374 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:38.116694 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:38.116699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:38.117124 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:38.117281 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:38.117290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:38.118313 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:38.118318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:38.119208 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:38.119219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:38.119961 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:38.119967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:38.120180 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:38.120729 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:38.120748 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:38.122712 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:38.126389 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:38.126398 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:38.126402 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:38.126889 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:38.127322 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:38.127326 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:38.127330 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:38.127528 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:38.128200 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:38.128205 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:38.128355 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 03:15:38.128473 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 03:15:38.128767 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260810 03:15:38.129154 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:38.116045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46640 (local address 127.18.112.124:39433)
0810 03:15:38.116218 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:38.116224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:38.116314 (+ 90us) server_negotiation.cc:407] Connection header received
0810 03:15:38.116492 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:38.116496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:38.116559 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:38.116645 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:38.117429 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:38.118187 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:38.119347 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:38.119829 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:38.119948 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:38.122916 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:38.122921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:38.122924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:38.122953 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:38.126240 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:38.127016 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:38.127022 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:38.127025 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:38.127189 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:38.127653 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:38.127658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:38.127661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:38.128081 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:38.128235 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:38.128616 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 03:15:38.128798 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:15:38.134045 6846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: Bootstrap starting.
I20260810 03:15:38.137130 6846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:38.138113 6846 log.cc:824] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:38.140789 6846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: No bootstrap required, opened a new log
I20260810 03:15:38.149304 6846 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:38.149600 6846 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:38.149712 6846 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2535048d01d041be8da3893f36d0a48b, State: Initialized, Role: FOLLOWER
I20260810 03:15:38.150233 6846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:38.151089 7029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.151517 7029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:38.152240 6846 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:38.168565 6738 master_runner.cc:263] No leader master found from master 2535048d01d041be8da3893f36d0a48b
I20260810 03:15:38.168704 6738 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 03:15:38.171278 7044 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:15:38.171459 7044 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260810 03:15:38.187522 6660 tablet.cc:2369] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:38.278906 6983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:15:38.279214 6983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:38.281064 6983 leader_election.cc:288] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2535048d01d041be8da3893f36d0a48b (127.18.112.125:44595), e1194e4700784b27b2af70a01f009e6d (127.18.112.124:39433)
I20260810 03:15:38.282045 6916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "059812ce538e4db5bdef4940ca5621c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1194e4700784b27b2af70a01f009e6d" is_pre_election: true
I20260810 03:15:38.282640 6916 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 059812ce538e4db5bdef4940ca5621c2 in term 0.
I20260810 03:15:38.283524 6806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "059812ce538e4db5bdef4940ca5621c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2535048d01d041be8da3893f36d0a48b" is_pre_election: true
I20260810 03:15:38.284112 6806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 059812ce538e4db5bdef4940ca5621c2 in term 0.
I20260810 03:15:38.284855 6656 leader_election.cc:302] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059812ce538e4db5bdef4940ca5621c2, e1194e4700784b27b2af70a01f009e6d; no voters:
I20260810 03:15:38.285820 6983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:15:38.285969 6983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:15:38.286069 6983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:38.292423 6983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:38.295349 6806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "059812ce538e4db5bdef4940ca5621c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2535048d01d041be8da3893f36d0a48b"
I20260810 03:15:38.295545 6806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:38.298921 6806 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059812ce538e4db5bdef4940ca5621c2 in term 1.
I20260810 03:15:38.299379 6656 leader_election.cc:302] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059812ce538e4db5bdef4940ca5621c2, 2535048d01d041be8da3893f36d0a48b; no voters:
I20260810 03:15:38.301772 6983 leader_election.cc:288] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [CANDIDATE]: Term 1 election: Requested vote from peers 2535048d01d041be8da3893f36d0a48b (127.18.112.125:44595), e1194e4700784b27b2af70a01f009e6d (127.18.112.124:39433)
I20260810 03:15:38.302304 6983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:38.302737 6983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [term 1 LEADER]: Becoming Leader. State: Replica: 059812ce538e4db5bdef4940ca5621c2, State: Running, Role: LEADER
I20260810 03:15:38.303526 6983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } }
I20260810 03:15:38.315076 6916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "059812ce538e4db5bdef4940ca5621c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1194e4700784b27b2af70a01f009e6d"
I20260810 03:15:38.315294 6916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:38.318529 6916 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059812ce538e4db5bdef4940ca5621c2 in term 1.
I20260810 03:15:38.323709 7046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 059812ce538e4db5bdef4940ca5621c2. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.324278 7046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:38.331265 7050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:38.334266 7050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:38.351290 6916 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [term 1 FOLLOWER]: Refusing update from remote peer 059812ce538e4db5bdef4940ca5621c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:38.354455 7046 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:38.361974 6806 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [term 1 FOLLOWER]: Refusing update from remote peer 059812ce538e4db5bdef4940ca5621c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:38.362778 7046 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:38.386008 7029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 059812ce538e4db5bdef4940ca5621c2. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.386322 7029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:38.390738 7051 mvcc.cc:205] Tried to move back new op lower bound from 7316814800268316672 to 7316814800103788544. Current Snapshot: MvccSnapshot[applied={T|T < 7316814800268316672}]
I20260810 03:15:38.403437 6983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.403715 6983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:38.404592 7050 catalog_manager.cc:1347] Generated new cluster ID: b10a33ec7d5849cd98254c5c9561f22d
I20260810 03:15:38.404690 7050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:38.409991 7029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.410211 7029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:38.421298 6994 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 059812ce538e4db5bdef4940ca5621c2. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.421684 6994 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:38.426959 7046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.427657 7046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:38.429601 7052 mvcc.cc:205] Tried to move back new op lower bound from 7316814800268316672 to 7316814800103788544. Current Snapshot: MvccSnapshot[applied={T|T < 7316814800268316672}]
I20260810 03:15:38.443626 6994 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "059812ce538e4db5bdef4940ca5621c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059812ce538e4db5bdef4940ca5621c2" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44777 } } peers { permanent_uuid: "2535048d01d041be8da3893f36d0a48b" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 44595 } } peers { permanent_uuid: "e1194e4700784b27b2af70a01f009e6d" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39433 } } }
I20260810 03:15:38.443898 6994 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:15:38.447017 7050 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:15:38.449769 7050 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:38.469182 7050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 059812ce538e4db5bdef4940ca5621c2: Generated new TSK 0
I20260810 03:15:38.470201 7050 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:15:39.009213 7022 catalog_manager.cc:1259] Loaded cluster ID: b10a33ec7d5849cd98254c5c9561f22d
I20260810 03:15:39.009315 7022 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: loading cluster ID for follower catalog manager: success
I20260810 03:15:39.011693 7022 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: acquiring CA information for follower catalog manager: success
I20260810 03:15:39.013358 7022 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1194e4700784b27b2af70a01f009e6d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:15:39.173386 7044 catalog_manager.cc:1259] Loaded cluster ID: b10a33ec7d5849cd98254c5c9561f22d
I20260810 03:15:39.173486 7044 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: loading cluster ID for follower catalog manager: success
I20260810 03:15:39.175998 7044 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: acquiring CA information for follower catalog manager: success
I20260810 03:15:39.177758 7044 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2535048d01d041be8da3893f36d0a48b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:15:39.603221 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 6630
I20260810 03:15:39.604491 6720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:39.710878 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 6630
I20260810 03:15:39.740757 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 6738
I20260810 03:15:39.741819 6835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:39.845100 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 6738
I20260810 03:15:39.867170 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 6856
I20260810 03:15:39.868209 6950 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:39.970441 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 6856
2026-08-10T03:15:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4842 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:15:40 dist-test-slave-jlzn krb5kdc[7080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:15:40 dist-test-slave-jlzn krb5kdc[7080](info): set up 2 sockets
Aug 10 03:15:40 dist-test-slave-jlzn krb5kdc[7080](info): commencing operation
krb5kdc: starting...
W20260810 03:15:41.158054 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:15:41 dist-test-slave-jlzn krb5kdc[7080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:15:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:15:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:15:41.373458 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:37459
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:33351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:37459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:41.684989 7098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:41.685250 7098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:41.685375 7098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:41.692215 7098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:41.692317 7098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:41.692390 7098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:41.692462 7098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:41.692528 7098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:41.702637 7098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:33351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:37459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:37459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:41.703747 7098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:41.704972 7098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:41.715824 7109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:41.715914 7105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:41.715869 7106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:41.716630 7098 server_base.cc:1034] running on GCE node
I20260810 03:15:41.717336 7098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:41.718532 7098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:41.719770 7098 hybrid_clock.cc:648] HybridClock initialized: now 1786331741719712 us; error 37 us; skew 500 ppm
I20260810 03:15:41.720185 7098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:41 dist-test-slave-jlzn krb5kdc[7080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331741, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:41.723023 7098 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:41.724424 7098 webserver.cc:460] Webserver started at http://127.18.112.126:39673/ using document root <none> and password file <none>
I20260810 03:15:41.725049 7098 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:41.725167 7098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:41.725435 7098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:41.728216 7098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "745dd11c250b4dd4afca3ab4ef41fd34"
format_stamp: "Formatted at 2026-08-10 03:15:41 on dist-test-slave-jlzn"
server_key: "acc6d426a3f74dfd67ca957440d58807"
server_key_iv: "3fbf2e3b84cbd4a98142209978294c20"
server_key_version: "encryptionkey@0"
I20260810 03:15:41.728924 7098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "745dd11c250b4dd4afca3ab4ef41fd34"
format_stamp: "Formatted at 2026-08-10 03:15:41 on dist-test-slave-jlzn"
server_key: "acc6d426a3f74dfd67ca957440d58807"
server_key_iv: "3fbf2e3b84cbd4a98142209978294c20"
server_key_version: "encryptionkey@0"
I20260810 03:15:41.733652 7098 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:15:41.736802 7118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:41.737982 7098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260810 03:15:41.738142 7098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "745dd11c250b4dd4afca3ab4ef41fd34"
format_stamp: "Formatted at 2026-08-10 03:15:41 on dist-test-slave-jlzn"
server_key: "acc6d426a3f74dfd67ca957440d58807"
server_key_iv: "3fbf2e3b84cbd4a98142209978294c20"
server_key_version: "encryptionkey@0"
I20260810 03:15:41.738309 7098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:41.778266 7098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:41.781831 7098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:41.782092 7098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:41.799226 7098 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:37459
I20260810 03:15:41.799259 7203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:37459 every 8 connection(s)
I20260810 03:15:41.800482 7098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:41.803932 7204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:41.810313 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 7098
I20260810 03:15:41.810555 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:15:41.811384 18881 external_mini_cluster.cc:1428] Setting key 86ecfe0c89dd67d74de0bf5e6affa22d
I20260810 03:15:41.814433 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: Bootstrap starting.
I20260810 03:15:41.817766 7204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:41.818848 7204 log.cc:824] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:41.821404 7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: No bootstrap required, opened a new log
Aug 10 03:15:41 dist-test-slave-jlzn krb5kdc[7080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:41.828770 7204 raft_consensus.cc:348] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } }
I20260810 03:15:41.829107 7204 raft_consensus.cc:374] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:41.829206 7204 raft_consensus.cc:729] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 745dd11c250b4dd4afca3ab4ef41fd34, State: Initialized, Role: FOLLOWER
I20260810 03:15:41.829819 7204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } }
I20260810 03:15:41.830102 7204 raft_consensus.cc:388] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:41.830272 7204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:41.830452 7204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:41.833159 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:41.813166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.18.112.126:37459)
0810 03:15:41.813880 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:41.813890 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:41.813948 (+ 58us) server_negotiation.cc:407] Connection header received
0810 03:15:41.815648 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:41.815672 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:41.816068 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:41.816378 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:41.818180 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:41.819494 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:41.820892 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:41.821542 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:41.821712 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:41.825599 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:41.825606 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:41.825619 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:41.825659 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:41.828661 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:41.829308 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:41.829316 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:41.829323 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:41.829525 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:41.829897 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:41.829902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:41.829905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:41.830629 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:41.830952 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:41.831348 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 03:15:41.831849 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":347,"threads_started":1}
I20260810 03:15:41.833662 7204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } }
I20260810 03:15:41.834121 7204 leader_election.cc:302] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 745dd11c250b4dd4afca3ab4ef41fd34; no voters:
I20260810 03:15:41.834738 7204 leader_election.cc:288] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:15:41.834837 7211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:41.836968 7204 sys_catalog.cc:564] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:41.837066 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:15:41.841478 7211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [term 1 LEADER]: Becoming Leader. State: Replica: 745dd11c250b4dd4afca3ab4ef41fd34, State: Running, Role: LEADER
I20260810 03:15:41.842021 7211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } }
I20260810 03:15:41.844946 7213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } } }
I20260810 03:15:41.845340 7213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:41.845482 7214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 745dd11c250b4dd4afca3ab4ef41fd34. Latest consensus state: current_term: 1 leader_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745dd11c250b4dd4afca3ab4ef41fd34" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37459 } } }
I20260810 03:15:41.845824 7214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34 [sys.catalog]: This master's current role is: LEADER
W20260810 03:15:41.851363 7235 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:15:41.851464 7235 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:15:41.851593 7236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:41.853775 7236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:41.861824 7236 catalog_manager.cc:1347] Generated new cluster ID: 826a011ef89a49e3b2c5f685fbb3e019
I20260810 03:15:41.861917 7236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:41.878176 7236 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:15:41.879900 7236 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:41.892702 7236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 745dd11c250b4dd4afca3ab4ef41fd34: Generated new TSK 0
I20260810 03:15:41.893539 7236 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:15:41.948002 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 7098
I20260810 03:15:41.949074 7196 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:42.041785 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 7098
2026-08-10T03:15:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2071 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:15:42 dist-test-slave-jlzn krb5kdc[7249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:15:42 dist-test-slave-jlzn krb5kdc[7249](info): set up 2 sockets
Aug 10 03:15:42 dist-test-slave-jlzn krb5kdc[7249](info): commencing operation
krb5kdc: starting...
W20260810 03:15:43.235185 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:15:43 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:15:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:15:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:15:43.450659 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:43.764166 7273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:43.764448 7273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:43.764596 7273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:43.771713 7273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:43.771847 7273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:43.771929 7273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:43.772013 7273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:43.772075 7273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:43.781404 7273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:43.782552 7273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:43.783751 7273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:43.795042 7279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:43.795106 7280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:43.795171 7284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:43.795917 7273 server_base.cc:1034] running on GCE node
I20260810 03:15:43.796669 7273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:43.797976 7273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:43.799211 7273 hybrid_clock.cc:648] HybridClock initialized: now 1786331743799111 us; error 85 us; skew 500 ppm
I20260810 03:15:43.799547 7273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:43 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:43.802563 7273 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:43.804003 7273 webserver.cc:460] Webserver started at http://127.18.112.126:44085/ using document root <none> and password file <none>
I20260810 03:15:43.804633 7273 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:43.804754 7273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:43.805047 7273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:43.807870 7273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "71546b7631e94cacb34728cf81ef7f86"
format_stamp: "Formatted at 2026-08-10 03:15:43 on dist-test-slave-jlzn"
server_key: "d0812906563fcc6fab655c9b9d3deff7"
server_key_iv: "985fc867c6841e7a15edfb8c73985e4d"
server_key_version: "encryptionkey@0"
I20260810 03:15:43.808614 7273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "71546b7631e94cacb34728cf81ef7f86"
format_stamp: "Formatted at 2026-08-10 03:15:43 on dist-test-slave-jlzn"
server_key: "d0812906563fcc6fab655c9b9d3deff7"
server_key_iv: "985fc867c6841e7a15edfb8c73985e4d"
server_key_version: "encryptionkey@0"
I20260810 03:15:43.813393 7273 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:15:43.816525 7291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:43.817752 7273 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:15:43.817914 7273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "71546b7631e94cacb34728cf81ef7f86"
format_stamp: "Formatted at 2026-08-10 03:15:43 on dist-test-slave-jlzn"
server_key: "d0812906563fcc6fab655c9b9d3deff7"
server_key_iv: "985fc867c6841e7a15edfb8c73985e4d"
server_key_version: "encryptionkey@0"
I20260810 03:15:43.818090 7273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:43.829962 7273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:43.833856 7273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:43.834102 7273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:43.850957 7273 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44203
I20260810 03:15:43.850988 7369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44203 every 8 connection(s)
I20260810 03:15:43.852249 7273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:43.855561 7371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:43.857633 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 7273
I20260810 03:15:43.857820 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:15:43.858435 18881 external_mini_cluster.cc:1428] Setting key faab032c7c15e645814f76b1b717c5dd
I20260810 03:15:43.866822 7371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap starting.
I20260810 03:15:43.870244 7371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:43.871434 7371 log.cc:824] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:15:43 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:43.874329 7371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: No bootstrap required, opened a new log
I20260810 03:15:43.880929 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:43.860288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.18.112.126:44203)
0810 03:15:43.861026 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:43.861036 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:43.861075 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:15:43.862743 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:43.862771 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:43.863240 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:43.863623 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:43.865285 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:43.866548 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:43.868436 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:43.869080 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:43.869202 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:43.873997 (+ 4795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:43.874004 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:43.874017 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:43.874050 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:43.877074 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:43.877867 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:43.877872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:43.877881 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:43.878039 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:43.878422 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:43.878425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:43.878427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:43.878964 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:43.879204 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:43.879607 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 03:15:43.879967 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":351,"threads_started":1}
I20260810 03:15:43.883117 7371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:43.883505 7371 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:43.883613 7371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Initialized, Role: FOLLOWER
I20260810 03:15:43.884152 7371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:43.884363 7371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:43.884490 7371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:43.884653 7371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:43.886598 7371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:43.887140 7371 leader_election.cc:302] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71546b7631e94cacb34728cf81ef7f86; no voters:
I20260810 03:15:43.887686 7371 leader_election.cc:288] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:15:43.887786 7380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:43.889461 7371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:43.892127 7380 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 LEADER]: Becoming Leader. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Running, Role: LEADER
I20260810 03:15:43.892596 7380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:43.895624 7382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:43.895972 7382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:43.896435 7383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71546b7631e94cacb34728cf81ef7f86. Latest consensus state: current_term: 1 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:43.896741 7383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
W20260810 03:15:43.902328 7399 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:15:43.902463 7399 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:15:43.903971 7400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:43.905464 7400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:43.913077 7400 catalog_manager.cc:1347] Generated new cluster ID: 8501782f24f94216b52c989fd0c963b5
I20260810 03:15:43.913179 7400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:43.936558 7400 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:15:43.937709 7400 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:43.943991 7400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Generated new TSK 0
I20260810 03:15:43.944648 7400 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:15:44.009670 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:44.321543 7407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:44.321807 7407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:44.321940 7407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:44.328860 7407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:44.328966 7407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:44.329113 7407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:15:44.338291 7407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:44.339389 7407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:44.340600 7407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:44.352816 7416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:44.352854 7420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:44.352876 7417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:44.353685 7407 server_base.cc:1034] running on GCE node
I20260810 03:15:44.354276 7407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:44.355093 7407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:44.356287 7407 hybrid_clock.cc:648] HybridClock initialized: now 1786331744356240 us; error 35 us; skew 500 ppm
I20260810 03:15:44.356563 7407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:44 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331744, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:44.359498 7407 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:15:44.360811 7407 webserver.cc:460] Webserver started at http://127.18.112.65:38961/ using document root <none> and password file <none>
I20260810 03:15:44.361410 7407 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:44.361526 7407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:44.361796 7407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:44.364530 7407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "0ab4c0c7f3574a3586953555861e8e53"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "4390a0035dbc7a69ecb5d7923732911a"
server_key_iv: "af2c203450313b7c2b6e79d310d1717a"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.365252 7407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "0ab4c0c7f3574a3586953555861e8e53"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "4390a0035dbc7a69ecb5d7923732911a"
server_key_iv: "af2c203450313b7c2b6e79d310d1717a"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.369824 7407 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:15:44.372946 7427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.374065 7407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:15:44.374210 7407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "0ab4c0c7f3574a3586953555861e8e53"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "4390a0035dbc7a69ecb5d7923732911a"
server_key_iv: "af2c203450313b7c2b6e79d310d1717a"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.374380 7407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:44.385522 7407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:44.389293 7407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:44.389576 7407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:44.390480 7407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:44.391762 7407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:44.391861 7407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.391976 7407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:44.392037 7407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.420249 7407 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:42915
I20260810 03:15:44.420310 7600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:42915 every 8 connection(s)
I20260810 03:15:44.421355 7407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:15:44.430214 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 7407
I20260810 03:15:44.430416 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:15:44.431121 18881 external_mini_cluster.cc:1428] Setting key 69ba8a2977965043c69ffdb81d18bb30
Aug 10 03:15:44 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331744, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:44.439604 7603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:44.423521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:38465 (local address 127.18.112.126:44203)
0810 03:15:44.423936 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:44.423940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:44.424739 (+ 799us) server_negotiation.cc:407] Connection header received
0810 03:15:44.426411 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:44.426417 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:44.426493 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:44.426584 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:44.427906 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.428613 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.430257 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.430748 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.430848 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:44.434403 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:44.434408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:44.434411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:44.434441 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:44.436775 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:44.437565 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:44.437569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:44.437572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:44.437699 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:44.438110 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:44.438113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:44.438115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:44.438359 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:44.438461 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:44.439161 (+ 700us) server_negotiation.cc:299] Negotiation successful
0810 03:15:44.439328 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":203,"threads_started":1}
I20260810 03:15:44.440709 7604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:44.423941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:38465)
0810 03:15:44.424592 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:44.424626 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:44.426163 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:44.426805 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:44.426813 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:44.427260 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:44.427745 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:44.427762 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.428782 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.428786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:44.430091 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:44.430107 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.430970 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.430979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:44.431266 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:44.431894 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:44.431916 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:44.434203 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:44.436909 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:44.436918 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:44.436931 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:44.437431 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:44.437797 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:44.437801 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:44.437804 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:44.438022 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:44.438470 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:44.438477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:44.438829 (+ 352us) client_negotiation.cc:769] Sending connection context
0810 03:15:44.439101 (+ 272us) client_negotiation.cc:240] Negotiation successful
0810 03:15:44.439534 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":248,"threads_started":1}
I20260810 03:15:44.442080 7601 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:44.442364 7601 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:44.443117 7601 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:44.445487 7315 ts_manager.cc:194] Registered new tserver with Master: 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:44.446909 7315 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:38465
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:15:44.486550 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:44.797209 7607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:44.797444 7607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:44.797536 7607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:44.804229 7607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:44.804318 7607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:44.804425 7607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:15:44.813246 7607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:44.814261 7607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:44.815436 7607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:44.827236 7612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:44.827327 7616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:44.827333 7614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:44.828142 7607 server_base.cc:1034] running on GCE node
I20260810 03:15:44.828666 7607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:44.829424 7607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:44.830598 7607 hybrid_clock.cc:648] HybridClock initialized: now 1786331744830532 us; error 62 us; skew 500 ppm
I20260810 03:15:44.830865 7607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:44 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331744, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:44.833755 7607 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:15:44.835050 7607 webserver.cc:460] Webserver started at http://127.18.112.66:35979/ using document root <none> and password file <none>
I20260810 03:15:44.835642 7607 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:44.835750 7607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:44.836069 7607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:44.838766 7607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "376bc0104e3940908a8e8539837a3afe"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "a7748e0696a7b5b02f9057823771e22c"
server_key_iv: "064dd2f456e29a19834b5c8043c71895"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.839462 7607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "376bc0104e3940908a8e8539837a3afe"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "a7748e0696a7b5b02f9057823771e22c"
server_key_iv: "064dd2f456e29a19834b5c8043c71895"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.844090 7607 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260810 03:15:44.847158 7628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.848362 7607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:15:44.848500 7607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "376bc0104e3940908a8e8539837a3afe"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "a7748e0696a7b5b02f9057823771e22c"
server_key_iv: "064dd2f456e29a19834b5c8043c71895"
server_key_version: "encryptionkey@0"
I20260810 03:15:44.848681 7607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:44.858593 7607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:44.862208 7607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:44.862447 7607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:44.863289 7607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:44.865567 7607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:44.865659 7607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.865820 7607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:44.865887 7607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:44.896575 7607 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:40841
I20260810 03:15:44.896608 7803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:40841 every 8 connection(s)
I20260810 03:15:44.897701 7607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:15:44.907249 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 7607
I20260810 03:15:44.907451 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:15:44.908046 18881 external_mini_cluster.cc:1428] Setting key 8d5ea42cbc8d9f9a05ba7da81d5bc806
Aug 10 03:15:44 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331744, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:44.915868 7603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:44.899885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:33443 (local address 127.18.112.126:44203)
0810 03:15:44.900053 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:44.900058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:44.901109 (+ 1051us) server_negotiation.cc:407] Connection header received
0810 03:15:44.902736 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:44.902742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:44.902821 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:44.902908 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:44.904213 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.904913 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.906292 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.906688 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.906773 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:44.910658 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:44.910663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:44.910666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:44.910695 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:44.913085 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:44.913740 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:44.913744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:44.913746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:44.913862 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:44.914265 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:44.914269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:44.914271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:44.914525 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:44.914665 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:44.915286 (+ 621us) server_negotiation.cc:299] Negotiation successful
0810 03:15:44.915509 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 03:15:44.916633 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:44.900300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:33443)
0810 03:15:44.900945 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:44.900986 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:44.902507 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:44.903086 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:44.903093 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:44.903532 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:44.904086 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:44.904103 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.905031 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.905035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:44.906187 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:44.906199 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:44.906840 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:44.906863 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:44.907152 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:44.907796 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:44.907858 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:44.910460 (+ 2602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:44.913213 (+ 2753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:44.913223 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:44.913236 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:44.913621 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:44.913962 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:44.913967 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:44.913972 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:44.914155 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:44.914652 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:44.914659 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:44.914938 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 03:15:44.915157 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 03:15:44.915601 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":261,"threads_started":1}
I20260810 03:15:44.917804 7805 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:44.918063 7805 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:44.918686 7805 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:44.919999 7315 ts_manager.cc:194] Registered new tserver with Master: 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841)
I20260810 03:15:44.920832 7315 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:33443
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:15:44.960706 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:45.268916 7815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:45.269146 7815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:45.269240 7815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:45.275969 7815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:45.276057 7815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:45.276163 7815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:15:45.285123 7815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:45.286106 7815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:45.287243 7815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:45.299412 7823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:45.299456 7829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:45.299480 7826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:45.300184 7815 server_base.cc:1034] running on GCE node
I20260810 03:15:45.300755 7815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:45.301570 7815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:45.302767 7815 hybrid_clock.cc:648] HybridClock initialized: now 1786331745302718 us; error 43 us; skew 500 ppm
I20260810 03:15:45.303038 7815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:45 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331745, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:45.305907 7815 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:15:45.307142 7815 webserver.cc:460] Webserver started at http://127.18.112.67:45113/ using document root <none> and password file <none>
I20260810 03:15:45.307739 7815 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:45.307873 7815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:45.308143 7815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:15:45.310755 7815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "1bdc792f5d554089ad213b3e80cc5bff"
format_stamp: "Formatted at 2026-08-10 03:15:45 on dist-test-slave-jlzn"
server_key: "d06407cc86db56f84c57d1643c71f317"
server_key_iv: "f030c77d9db4b4974dce3b5be6de7e52"
server_key_version: "encryptionkey@0"
I20260810 03:15:45.311466 7815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "1bdc792f5d554089ad213b3e80cc5bff"
format_stamp: "Formatted at 2026-08-10 03:15:45 on dist-test-slave-jlzn"
server_key: "d06407cc86db56f84c57d1643c71f317"
server_key_iv: "f030c77d9db4b4974dce3b5be6de7e52"
server_key_version: "encryptionkey@0"
I20260810 03:15:45.316033 7815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:15:45.319103 7838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:45.320308 7815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:15:45.320449 7815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "1bdc792f5d554089ad213b3e80cc5bff"
format_stamp: "Formatted at 2026-08-10 03:15:45 on dist-test-slave-jlzn"
server_key: "d06407cc86db56f84c57d1643c71f317"
server_key_iv: "f030c77d9db4b4974dce3b5be6de7e52"
server_key_version: "encryptionkey@0"
I20260810 03:15:45.320613 7815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:45.340992 7815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:45.344408 7815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:45.344655 7815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:45.345484 7815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:45.346686 7815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:45.346767 7815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:45.346884 7815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:45.346936 7815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:45.375157 7815 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:44359
I20260810 03:15:45.375212 8008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:44359 every 8 connection(s)
I20260810 03:15:45.376317 7815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:15:45.379974 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 7815
I20260810 03:15:45.380168 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:15:45.380601 18881 external_mini_cluster.cc:1428] Setting key fa4e2de6acf17cd2667dfb4e165bd93d
Aug 10 03:15:45 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331745, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:45.394589 7603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.378594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:60209 (local address 127.18.112.126:44203)
0810 03:15:45.378798 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.378804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.379981 (+ 1177us) server_negotiation.cc:407] Connection header received
0810 03:15:45.381915 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.381921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.382001 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.382084 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:45.383565 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.384323 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.385798 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.386205 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.386313 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.389413 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:45.389418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:45.389421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:45.389450 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:45.391786 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.392438 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.392443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.392447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.392568 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.393006 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.393011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.393015 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.393296 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:45.393426 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.394134 (+ 708us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.394331 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:15:45.395547 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.379154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:60209)
0810 03:15:45.379837 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.379885 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.381643 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.382334 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.382344 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.382840 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:45.383415 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.383432 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.384466 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.384470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.385652 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.385664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.386415 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.386423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.386642 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.387152 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:45.387177 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:45.389199 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:45.391918 (+ 2719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:45.391927 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:45.391940 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:45.392328 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:45.392676 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:45.392681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:45.392684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:45.392906 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:45.393418 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:45.393425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:45.393716 (+ 291us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.394006 (+ 290us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.394439 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":251,"threads_started":1}
I20260810 03:15:45.396660 8010 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:45.396886 8010 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:45.397480 8010 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:45.398715 7315 ts_manager.cc:194] Registered new tserver with Master: 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67:44359)
I20260810 03:15:45.399489 7315 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:60209
I20260810 03:15:45.407076 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:15:45.423368 7603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.411179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53282 (local address 127.18.112.126:44203)
0810 03:15:45.411313 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.411317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.411743 (+ 426us) server_negotiation.cc:407] Connection header received
0810 03:15:45.411908 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.411913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.411966 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.412038 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:45.413336 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.414015 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.415200 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.415575 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.415656 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.417753 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:45.417759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:45.417763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:45.417796 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:45.420622 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.421306 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.421311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.421315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.421473 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.421863 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.421868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.421871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.422244 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:45.422497 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.422839 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.423056 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:15:45.427001 7315 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53282:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:15:45.433544 7315 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:15:45.449523 7601 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:45.454214 8032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.445497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57482)
0810 03:15:45.446456 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.446471 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.446577 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.447558 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.447562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.447586 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:45.448003 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.448016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.449753 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.449758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.451651 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.451663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.453502 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.453508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.453659 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.453692 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.453768 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.453891 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":1,"thread_start_us":696,"threads_started":1}
I20260810 03:15:45.454819 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.443775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:44359 (local address 127.0.0.1:41694)
0810 03:15:45.445567 (+ 1792us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.445599 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.445778 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.446661 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.446665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.446688 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:45.447139 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.447152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.449067 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.449072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.451623 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.451639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.453993 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.454000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.454197 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.454232 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.454307 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.454431 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"mutex_wait_us":4,"thread_start_us":947,"threads_started":1}
I20260810 03:15:45.455188 8030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.444191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:40841 (local address 127.0.0.1:54174)
0810 03:15:45.445417 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.445600 (+ 183us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.445751 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.446455 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.446463 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.446498 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:45.446958 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.446972 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.449174 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.449178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.452628 (+ 3450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.452653 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.454433 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.454438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.454617 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.454657 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.454723 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.454842 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"mutex_wait_us":1223,"thread_start_us":860,"threads_started":1}
I20260810 03:15:45.455308 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.446029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.18.112.65:42915)
0810 03:15:45.447097 (+ 1068us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.447105 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.447130 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:15:45.447226 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.447233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.447403 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.447547 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:45.448196 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.449546 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.451846 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.453292 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.454650 (+ 1358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.454805 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.454856 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.455004 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":778,"threads_started":1}
I20260810 03:15:45.455503 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.444090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41694 (local address 127.18.112.67:44359)
0810 03:15:45.444754 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.444762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.445697 (+ 935us) server_negotiation.cc:407] Connection header received
0810 03:15:45.445965 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.445972 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.446190 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.446353 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:45.447343 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.448928 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.451890 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.453470 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.453563 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.453779 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.455032 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.455202 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":368,"threads_started":1}
I20260810 03:15:45.456918 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.444772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54174 (local address 127.18.112.66:40841)
0810 03:15:45.445789 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.445798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.445826 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:15:45.445933 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.445940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.446187 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.447134 (+ 947us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:45.447330 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.449046 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.452821 (+ 3775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.454203 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.455509 (+ 1306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.456385 (+ 876us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.456450 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.456604 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":1125,"threads_started":1}
I20260810 03:15:45.458709 7906 tablet_service.cc:1467] Processing CreateTablet for tablet 6e94b6603d234967925177e82ad276c6 (DEFAULT_TABLE table=test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:45.458787 7495 tablet_service.cc:1467] Processing CreateTablet for tablet 6e94b6603d234967925177e82ad276c6 (DEFAULT_TABLE table=test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:45.459919 7906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e94b6603d234967925177e82ad276c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:45.460153 7495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e94b6603d234967925177e82ad276c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:45.460170 7699 tablet_service.cc:1467] Processing CreateTablet for tablet 6e94b6603d234967925177e82ad276c6 (DEFAULT_TABLE table=test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:45.461354 7699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e94b6603d234967925177e82ad276c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:45.470500 8035 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Bootstrap starting.
I20260810 03:15:45.473580 8035 tablet_bootstrap.cc:654] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:45.473568 8036 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Bootstrap starting.
I20260810 03:15:45.474599 8037 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Bootstrap starting.
I20260810 03:15:45.475852 8035 log.cc:824] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:45.476756 8036 tablet_bootstrap.cc:654] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:45.477795 8037 tablet_bootstrap.cc:654] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:45.477807 8036 log.cc:824] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:45.478961 8037 log.cc:824] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:45.479034 8035 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: No bootstrap required, opened a new log
I20260810 03:15:45.479274 8035 ts_tablet_manager.cc:1397] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260810 03:15:45.480423 8036 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: No bootstrap required, opened a new log
I20260810 03:15:45.480655 8036 ts_tablet_manager.cc:1397] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:15:45.481700 8037 tablet_bootstrap.cc:492] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: No bootstrap required, opened a new log
I20260810 03:15:45.481933 8037 ts_tablet_manager.cc:1397] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 03:15:45.487537 8036 raft_consensus.cc:348] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.487879 8036 raft_consensus.cc:374] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:45.487977 8036 raft_consensus.cc:729] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab4c0c7f3574a3586953555861e8e53, State: Initialized, Role: FOLLOWER
I20260810 03:15:45.488500 8036 consensus_queue.cc:260] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.489030 8035 raft_consensus.cc:348] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.489526 8035 raft_consensus.cc:374] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:45.489701 8035 raft_consensus.cc:729] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdc792f5d554089ad213b3e80cc5bff, State: Initialized, Role: FOLLOWER
I20260810 03:15:45.490074 8036 ts_tablet_manager.cc:1428] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260810 03:15:45.490294 8035 consensus_queue.cc:260] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.492103 8035 ts_tablet_manager.cc:1428] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260810 03:15:45.491938 8037 raft_consensus.cc:348] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.492355 8037 raft_consensus.cc:374] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:45.492443 8037 raft_consensus.cc:729] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376bc0104e3940908a8e8539837a3afe, State: Initialized, Role: FOLLOWER
I20260810 03:15:45.492833 8037 consensus_queue.cc:260] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.493052 8010 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:45.494359 8037 ts_tablet_manager.cc:1428] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260810 03:15:45.494601 7805 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:45.500447 8044 raft_consensus.cc:482] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:15:45.500635 8044 raft_consensus.cc:504] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.501935 8044 leader_election.cc:288] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841), 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:45.507108 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.502242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:40841 (local address 127.18.112.67:44703)
0810 03:15:45.502387 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.502401 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.502491 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.502844 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.502849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.502877 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:45.503075 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.503088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.504064 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.504072 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.505543 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.505557 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.506553 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.506559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.506749 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.506778 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.506844 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.506931 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 03:15:45.507256 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.502194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:44703 (local address 127.18.112.66:40841)
0810 03:15:45.502375 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.502381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.502458 (+ 77us) server_negotiation.cc:407] Connection header received
0810 03:15:45.502611 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.502615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.502698 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.502790 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:45.503211 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.503925 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.505689 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.506413 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.506517 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.506562 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.506894 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.507018 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:15:45.508101 7730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e94b6603d234967925177e82ad276c6" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376bc0104e3940908a8e8539837a3afe" is_pre_election: true
I20260810 03:15:45.508633 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.502743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:35193 (local address 127.18.112.65:42915)
0810 03:15:45.502908 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.502913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.503432 (+ 519us) server_negotiation.cc:407] Connection header received
0810 03:15:45.503577 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.503582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.503643 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.503713 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:45.504304 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.504984 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.506715 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.507796 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.507974 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.508039 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.508299 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.508422 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:15:45.508642 8048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.502587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.18.112.67:35193)
0810 03:15:45.503344 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:45.503356 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:45.503461 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:45.503740 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:45.503744 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:45.503767 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:45.504145 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.504160 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.505137 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.505143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.506582 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:45.506593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.507994 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.508000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:45.508147 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.508176 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:15:45.508269 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 03:15:45.508385 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":471,"threads_started":1}
I20260810 03:15:45.508562 7730 raft_consensus.cc:2454] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 0.
I20260810 03:15:45.509328 7843 leader_election.cc:302] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdc792f5d554089ad213b3e80cc5bff, 376bc0104e3940908a8e8539837a3afe; no voters:
I20260810 03:15:45.509655 8044 raft_consensus.cc:2781] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:15:45.509554 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e94b6603d234967925177e82ad276c6" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab4c0c7f3574a3586953555861e8e53" is_pre_election: true
I20260810 03:15:45.509770 8044 raft_consensus.cc:482] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:15:45.509860 8044 raft_consensus.cc:3037] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:45.510006 7529 raft_consensus.cc:2454] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 0.
I20260810 03:15:45.512111 8044 raft_consensus.cc:504] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.512634 8044 leader_election.cc:288] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 election: Requested vote from peers 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841), 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:45.513016 7730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e94b6603d234967925177e82ad276c6" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376bc0104e3940908a8e8539837a3afe"
I20260810 03:15:45.513047 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e94b6603d234967925177e82ad276c6" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab4c0c7f3574a3586953555861e8e53"
I20260810 03:15:45.513172 7730 raft_consensus.cc:3037] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:45.513202 7529 raft_consensus.cc:3037] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:45.515177 7730 raft_consensus.cc:2454] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 1.
I20260810 03:15:45.515192 7529 raft_consensus.cc:2454] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 1.
I20260810 03:15:45.515496 7843 leader_election.cc:302] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdc792f5d554089ad213b3e80cc5bff, 376bc0104e3940908a8e8539837a3afe; no voters:
I20260810 03:15:45.515779 8044 raft_consensus.cc:2781] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:45.516194 8044 raft_consensus.cc:686] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 LEADER]: Becoming Leader. State: Replica: 1bdc792f5d554089ad213b3e80cc5bff, State: Running, Role: LEADER
I20260810 03:15:45.516649 8044 consensus_queue.cc:237] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:45.520722 7311 catalog_manager.cc:5495] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67). New cstate: current_term: 1 leader_uuid: "1bdc792f5d554089ad213b3e80cc5bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } health_report { overall_health: UNKNOWN } } }
I20260810 03:15:45.534780 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.530350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41700 (local address 127.18.112.67:44359)
0810 03:15:45.530503 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.530508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.530523 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:15:45.530609 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.530612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.530678 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.530785 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:15:45.531075 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.531791 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.533087 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.533464 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.533547 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.533928 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:15:45.534362 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:15:45.534467 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.534503 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.534559 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:15:45.541946 7730 raft_consensus.cc:1261] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Refusing update from remote peer 1bdc792f5d554089ad213b3e80cc5bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:45.541965 7529 raft_consensus.cc:1261] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Refusing update from remote peer 1bdc792f5d554089ad213b3e80cc5bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:45.542788 8049 consensus_queue.cc:1035] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:45.543090 8044 consensus_queue.cc:1035] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:45.566809 7311 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:45.567101 7311 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53282:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:45.570592 7311 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Sending DeleteTablet for 3 replicas of tablet 6e94b6603d234967925177e82ad276c6
I20260810 03:15:45.571651 7906 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e94b6603d234967925177e82ad276c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:45 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:41694
I20260810 03:15:45.571785 7699 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e94b6603d234967925177e82ad276c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:45 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:54174
I20260810 03:15:45.571897 7495 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e94b6603d234967925177e82ad276c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:45 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:57482
I20260810 03:15:45.572887 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 7407
I20260810 03:15:45.589174 8074 tablet_replica.cc:330] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: stopping tablet replica
I20260810 03:15:45.589382 8072 tablet_replica.cc:330] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: stopping tablet replica
I20260810 03:15:45.589789 8074 raft_consensus.cc:2229] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:45.589903 8072 raft_consensus.cc:2229] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:45.590180 8071 tablet_replica.cc:330] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: stopping tablet replica
I20260810 03:15:45.590389 8074 raft_consensus.cc:2258] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:45.590389 8072 raft_consensus.cc:2258] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:45.590651 8071 raft_consensus.cc:2229] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:15:45.591872 8071 raft_consensus.cc:2258] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:45.592886 8072 ts_tablet_manager.cc:1905] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:45.593226 8074 ts_tablet_manager.cc:1905] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 03:15:45 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:15:45.598652 8071 ts_tablet_manager.cc:1905] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:45.599711 8074 ts_tablet_manager.cc:1918] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:45.599932 8074 log.cc:1196] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/6e94b6603d234967925177e82ad276c6
I20260810 03:15:45.599941 8072 ts_tablet_manager.cc:1918] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:45.600155 8072 log.cc:1196] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/6e94b6603d234967925177e82ad276c6
I20260810 03:15:45.600540 8074 ts_tablet_manager.cc:1939] T 6e94b6603d234967925177e82ad276c6 P 0ab4c0c7f3574a3586953555861e8e53: Deleting consensus metadata
I20260810 03:15:45.600705 8072 ts_tablet_manager.cc:1939] T 6e94b6603d234967925177e82ad276c6 P 376bc0104e3940908a8e8539837a3afe: Deleting consensus metadata
I20260810 03:15:45.602185 7298 catalog_manager.cc:4841] TS 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915): tablet 6e94b6603d234967925177e82ad276c6 (table test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]) successfully deleted
I20260810 03:15:45.602509 7298 catalog_manager.cc:4841] TS 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841): tablet 6e94b6603d234967925177e82ad276c6 (table test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]) successfully deleted
I20260810 03:15:45.605082 8071 ts_tablet_manager.cc:1918] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:45.605252 8071 log.cc:1196] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/6e94b6603d234967925177e82ad276c6
I20260810 03:15:45.605654 8071 ts_tablet_manager.cc:1939] T 6e94b6603d234967925177e82ad276c6 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting consensus metadata
I20260810 03:15:45.606920 7294 catalog_manager.cc:4841] TS 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67:44359): tablet 6e94b6603d234967925177e82ad276c6 (table test-table [id=7f3da8a2c37f4fb0b3d8b47b56e8fff2]) successfully deleted
I20260810 03:15:45.610893 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.574072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57486 (local address 127.18.112.65:42915)
0810 03:15:45.574240 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.574246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.580625 (+ 6379us) server_negotiation.cc:407] Connection header received
0810 03:15:45.581552 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.581559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.581639 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.581707 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:45.585621 (+ 3914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.586879 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.592084 (+ 5205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.592697 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.592794 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.604942 (+ 12148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:45.604956 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:45.604972 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:45.605018 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:45.608232 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.608931 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.608937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.608940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.609064 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.609417 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.609420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.609422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.609799 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:45.610080 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.610367 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.610559 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:15:45.611487 7595 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:45.697294 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 7407
I20260810 03:15:45.729825 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 7607
Aug 10 03:15:45 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:15:45.746253 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.730630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54178 (local address 127.18.112.66:40841)
0810 03:15:45.730807 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.730812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.730831 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:15:45.730993 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.730997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.731070 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.731154 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:45.732792 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.733509 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.735327 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.735689 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.735774 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.740847 (+ 5073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:45.740862 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:45.740876 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:45.740914 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:45.743553 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.744274 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.744281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.744284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.744408 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.744771 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.744775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.744777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.745160 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:45.745427 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.745741 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.745953 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:15:45.746853 7794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:45.834054 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 7607
I20260810 03:15:45.857121 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 7815
Aug 10 03:15:45 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:15:45.876941 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:45.857959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.18.112.67:44359)
0810 03:15:45.858145 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:45.858152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:45.858339 (+ 187us) server_negotiation.cc:407] Connection header received
0810 03:15:45.858541 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:45.858546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:45.858627 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:45.858732 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:45.860570 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.861802 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.863619 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:45.864297 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:45.864420 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:45.870086 (+ 5666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:45.870108 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:45.870130 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:45.870181 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:45.874027 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.874669 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.874678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.874682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.874859 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:45.875176 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:45.875182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:45.875185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:45.875682 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:45.876022 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:45.876300 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:15:45.876540 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:15:45.877681 8002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:45.995853 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 7815
I20260810 03:15:46.024026 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 7273
I20260810 03:15:46.025115 7359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:46.130251 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 7273
I20260810 03:15:46.157552 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--webserver_interface=127.18.112.126
--webserver_port=44085
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:46.473869 8085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:46.474120 8085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:46.474212 8085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:46.481110 8085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:46.481201 8085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:46.481252 8085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:46.481305 8085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:46.481348 8085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:46.490360 8085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=44085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:46.491400 8085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:46.492583 8085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:46.515496 8092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:46.515443 8095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:46.515473 8093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:46.516247 8085 server_base.cc:1034] running on GCE node
I20260810 03:15:46.517064 8085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:46.518476 8085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:46.519690 8085 hybrid_clock.cc:648] HybridClock initialized: now 1786331746519629 us; error 49 us; skew 500 ppm
I20260810 03:15:46.520090 8085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:46 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331746, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:46.523332 8085 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:46.524906 8085 webserver.cc:460] Webserver started at http://127.18.112.126:44085/ using document root <none> and password file <none>
I20260810 03:15:46.525586 8085 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:46.525729 8085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:46.531268 8085 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 03:15:46.534068 8104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:46.535281 8085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:15:46.535444 8085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "71546b7631e94cacb34728cf81ef7f86"
format_stamp: "Formatted at 2026-08-10 03:15:43 on dist-test-slave-jlzn"
server_key: "d0812906563fcc6fab655c9b9d3deff7"
server_key_iv: "985fc867c6841e7a15edfb8c73985e4d"
server_key_version: "encryptionkey@0"
I20260810 03:15:46.536504 8085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:46.555404 8085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:46.558993 8085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:46.559234 8085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:46.576597 8085 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44203
I20260810 03:15:46.576619 8191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44203 every 8 connection(s)
I20260810 03:15:46.577934 8085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:46.579492 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8085
I20260810 03:15:46.580606 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:42915
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=38961
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:46.586594 8192 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:15:46.590824 8192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap starting.
I20260810 03:15:46.609730 8192 log.cc:824] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:46.621652 8192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:15:46.622153 8192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap complete.
I20260810 03:15:46.630800 8192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:46.631592 8192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Initialized, Role: FOLLOWER
I20260810 03:15:46.632203 8192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:46.632424 8192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:46.632535 8192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:46.632694 8192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:15:46.636282 8192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:46.636754 8192 leader_election.cc:302] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71546b7631e94cacb34728cf81ef7f86; no voters:
I20260810 03:15:46.637336 8192 leader_election.cc:288] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:15:46.637473 8197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:15:46.638221 8197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 LEADER]: Becoming Leader. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Running, Role: LEADER
I20260810 03:15:46.638885 8197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:46.640149 8192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:46.641569 8201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:46.641615 8199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71546b7631e94cacb34728cf81ef7f86. Latest consensus state: current_term: 2 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:46.641970 8201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:46.641992 8199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:46.659294 8208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:46.667156 8208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:46.668668 8208 catalog_manager.cc:1259] Loaded cluster ID: 8501782f24f94216b52c989fd0c963b5
I20260810 03:15:46.668828 8208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:15:46.671936 8208 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 03:15:46.688880 8208 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 03:15:46.697840 8208 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:15:46.699323 8208 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Loaded TSK: 0
I20260810 03:15:46.700409 8208 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:15:46.944778 8195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:46.945042 8195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:46.945174 8195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:46.952812 8195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:46.952917 8195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:46.953053 8195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:15:46.962308 8195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:42915
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=38961
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:46.963392 8195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:46.964650 8195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:46.978325 8232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:46.978355 8233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:46.979264 8238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:46.980132 8195 server_base.cc:1034] running on GCE node
I20260810 03:15:46.980712 8195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:46.981655 8195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:46.982860 8195 hybrid_clock.cc:648] HybridClock initialized: now 1786331746982802 us; error 53 us; skew 500 ppm
I20260810 03:15:46.983146 8195 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:46 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331746, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:46.986266 8195 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:15:46.987684 8195 webserver.cc:460] Webserver started at http://127.18.112.65:38961/ using document root <none> and password file <none>
I20260810 03:15:46.988339 8195 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:46.988472 8195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:46.993538 8195 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:15:46.996222 8250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:46.997586 8195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:46.997740 8195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "0ab4c0c7f3574a3586953555861e8e53"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "4390a0035dbc7a69ecb5d7923732911a"
server_key_iv: "af2c203450313b7c2b6e79d310d1717a"
server_key_version: "encryptionkey@0"
I20260810 03:15:46.998642 8195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:47.010486 8195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:47.014321 8195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:47.014547 8195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:47.015415 8195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:47.016695 8195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:47.016794 8195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.016911 8195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:47.016981 8195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.054173 8195 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:42915
I20260810 03:15:47.054240 8433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:42915 every 8 connection(s)
I20260810 03:15:47.055558 8195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:15:47.058048 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8195
I20260810 03:15:47.058841 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:40841
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=35979
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:15:47 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331746, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:47.078260 8438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.058630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:59833)
0810 03:15:47.059405 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:47.059449 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:47.061168 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:47.062532 (+ 1364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:47.062542 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:47.063122 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:47.063628 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.063645 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.065236 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.065240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.066472 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.066485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.067455 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.067463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.067722 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.068368 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:47.068397 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:47.070782 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:47.074654 (+ 3872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.074661 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.074670 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.075060 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.075508 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.075511 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.075513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.075699 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.076526 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:47.076532 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:47.076811 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 03:15:47.077019 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 03:15:47.077358 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":343,"threads_started":1}
I20260810 03:15:47.078763 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.058291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:59833 (local address 127.18.112.126:44203)
0810 03:15:47.058863 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.058874 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.059581 (+ 707us) server_negotiation.cc:407] Connection header received
0810 03:15:47.061739 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.061754 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.062053 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.062361 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:47.063867 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.065079 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.066614 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.067237 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.067417 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.071052 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:47.071061 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:47.071078 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:47.071119 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:47.074494 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.075193 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.075201 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.075208 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.075415 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.075824 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.075829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.075832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.076411 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:47.076605 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:47.077282 (+ 677us) server_negotiation.cc:299] Negotiation successful
0810 03:15:47.077688 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":254,"threads_started":1}
I20260810 03:15:47.081370 8434 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:47.081707 8434 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:47.082561 8434 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:47.084806 8133 ts_manager.cc:194] Registered new tserver with Master: 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:47.086297 8133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:59833
W20260810 03:15:47.375061 8439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:47.375291 8439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:47.375417 8439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:47.382334 8439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:47.382431 8439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:47.382579 8439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:15:47.391507 8439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:40841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=35979
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:47.392597 8439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:47.393747 8439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:47.405697 8446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:47.405882 8448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:47.406284 8452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:47.406913 8439 server_base.cc:1034] running on GCE node
I20260810 03:15:47.407413 8439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:47.408234 8439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:47.409426 8439 hybrid_clock.cc:648] HybridClock initialized: now 1786331747409377 us; error 41 us; skew 500 ppm
I20260810 03:15:47.409698 8439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:47 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331747, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:47.415292 8439 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:15:47.416669 8439 webserver.cc:460] Webserver started at http://127.18.112.66:35979/ using document root <none> and password file <none>
I20260810 03:15:47.417279 8439 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:47.417404 8439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:47.422246 8439 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:15:47.424779 8461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.425926 8439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:47.426069 8439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "376bc0104e3940908a8e8539837a3afe"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "a7748e0696a7b5b02f9057823771e22c"
server_key_iv: "064dd2f456e29a19834b5c8043c71895"
server_key_version: "encryptionkey@0"
I20260810 03:15:47.426939 8439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:47.462041 8439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:47.465467 8439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:47.465696 8439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:47.466540 8439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:47.467710 8439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:47.467836 8439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.467945 8439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:47.468017 8439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.497210 8439 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:40841
I20260810 03:15:47.497279 8618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:40841 every 8 connection(s)
I20260810 03:15:47.498481 8439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:15:47.505751 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8439
I20260810 03:15:47.506345 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:44359
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=45113
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:15:47 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331747, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:47.517441 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.500666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:38285 (local address 127.18.112.126:44203)
0810 03:15:47.500831 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.500836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.501995 (+ 1159us) server_negotiation.cc:407] Connection header received
0810 03:15:47.503872 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.503879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.503959 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.504047 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:47.505437 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.506163 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.507680 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.508191 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.508302 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.512017 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:47.512023 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:47.512026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:47.512060 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:47.514434 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.515098 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.515103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.515106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.515266 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.515676 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.515681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.515685 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.516029 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:47.516184 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:47.516893 (+ 709us) server_negotiation.cc:299] Negotiation successful
0810 03:15:47.517121 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:15:47.518432 8622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.501108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:38285)
0810 03:15:47.501861 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:47.501897 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:47.503597 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:47.504291 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:47.504299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:47.504751 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:47.505264 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.505281 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.506316 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.506320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.507531 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.507544 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.508403 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.508411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.508618 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.509311 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:47.509345 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:47.511759 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:47.514562 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.514570 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.514584 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.514972 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.515374 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.515379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.515383 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.515566 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.516254 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:47.516261 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:47.516543 (+ 282us) client_negotiation.cc:769] Sending connection context
0810 03:15:47.516770 (+ 227us) client_negotiation.cc:240] Negotiation successful
0810 03:15:47.517227 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":258,"threads_started":1}
I20260810 03:15:47.519711 8620 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:47.520051 8620 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:47.520828 8620 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:47.522306 8133 ts_manager.cc:194] Registered new tserver with Master: 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841)
I20260810 03:15:47.523066 8133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:38285
W20260810 03:15:47.827988 8623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:47.828250 8623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:47.828387 8623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:47.835247 8623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:47.835343 8623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:47.835497 8623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:15:47.844806 8623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:44359
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=45113
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:47.845943 8623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:47.847193 8623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:47.859517 8632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:47.859385 8633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:47.859385 8636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:47.860097 8623 server_base.cc:1034] running on GCE node
I20260810 03:15:47.860667 8623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:47.861568 8623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:47.862833 8623 hybrid_clock.cc:648] HybridClock initialized: now 1786331747862778 us; error 48 us; skew 500 ppm
I20260810 03:15:47.863102 8623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:47 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331747, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:47.865955 8623 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:15:47.867208 8623 webserver.cc:460] Webserver started at http://127.18.112.67:45113/ using document root <none> and password file <none>
I20260810 03:15:47.867825 8623 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:47.867967 8623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:47.872802 8623 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:15:47.875211 8646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.876389 8623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:15:47.876538 8623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "1bdc792f5d554089ad213b3e80cc5bff"
format_stamp: "Formatted at 2026-08-10 03:15:45 on dist-test-slave-jlzn"
server_key: "d06407cc86db56f84c57d1643c71f317"
server_key_iv: "f030c77d9db4b4974dce3b5be6de7e52"
server_key_version: "encryptionkey@0"
I20260810 03:15:47.877422 8623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:47.898165 8623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:47.901697 8623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:47.901918 8623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:47.902838 8623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:47.904052 8623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:47.904155 8623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.904258 8623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:47.904325 8623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:47.933199 8623 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:44359
I20260810 03:15:47.933267 8815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:44359 every 8 connection(s)
I20260810 03:15:47.934454 8623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:15:47.943037 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8623
Aug 10 03:15:47 dist-test-slave-jlzn krb5kdc[7249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331747, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:15:47.954164 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.936735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:53143 (local address 127.18.112.126:44203)
0810 03:15:47.936910 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.936915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.937948 (+ 1033us) server_negotiation.cc:407] Connection header received
0810 03:15:47.939724 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.939730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.939831 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.939917 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:47.941358 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.942075 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.943589 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.944216 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.944344 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.948006 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:47.948013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:47.948017 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:47.948055 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:47.951225 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.951895 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.951901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.951904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.952075 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.952472 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.952477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.952480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.952810 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:47.952937 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:47.953717 (+ 780us) server_negotiation.cc:299] Negotiation successful
0810 03:15:47.953934 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:15:47.955286 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.937137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:53143)
0810 03:15:47.937802 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:47.937837 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:47.939441 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:47.940204 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:47.940211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:47.940662 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:15:47.941195 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.941220 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.942228 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.942232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.943453 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.943467 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.944689 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.944697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:47.944930 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.945492 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:15:47.945519 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:15:47.947761 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:15:47.951349 (+ 3588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.951355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.951365 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.951770 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.952197 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:15:47.952200 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:15:47.952202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:15:47.952372 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:15:47.952922 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:15:47.952929 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:15:47.953309 (+ 380us) client_negotiation.cc:769] Sending connection context
0810 03:15:47.953594 (+ 285us) client_negotiation.cc:240] Negotiation successful
0810 03:15:47.954054 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":260,"threads_started":1}
I20260810 03:15:47.956633 8816 heartbeater.cc:347] Connected to a master server at 127.18.112.126:44203
I20260810 03:15:47.956936 8816 heartbeater.cc:464] Registering TS with master...
I20260810 03:15:47.957721 8816 heartbeater.cc:511] Master 127.18.112.126:44203 requested a full tablet report, sending...
I20260810 03:15:47.958653 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.943965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53298 (local address 127.18.112.126:44203)
0810 03:15:47.944905 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.944909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.944923 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:15:47.944960 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.944963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.945011 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.945097 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:47.946604 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.947550 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.949313 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.949769 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.949862 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.952914 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:47.952921 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:47.952925 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:47.952964 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:47.956180 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.956908 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.956912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.956914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.957029 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:47.957411 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:47.957414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:47.957416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:47.957641 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:47.957830 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:47.958198 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 03:15:47.958343 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":731,"threads_started":1}
I20260810 03:15:47.959551 8132 ts_manager.cc:194] Registered new tserver with Master: 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67:44359)
I20260810 03:15:47.960860 8132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:53143
I20260810 03:15:47.961409 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:15:47.967592 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.962257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.18.112.126:44203)
0810 03:15:47.962391 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.962395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.962842 (+ 447us) server_negotiation.cc:407] Connection header received
0810 03:15:47.963024 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.963029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.963149 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.963266 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:15:47.963667 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.964372 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.965729 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:47.966124 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:47.966227 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:47.966679 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:15:47.967081 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:15:47.967198 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:47.967308 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 03:15:47.967378 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 03:15:47.968426 8132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:15:47.975172 8132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:15:48.006592 8834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.986094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54190 (local address 127.18.112.66:40841)
0810 03:15:47.997059 (+ 10965us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:47.997069 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:47.997771 (+ 702us) server_negotiation.cc:407] Connection header received
0810 03:15:47.998108 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:47.998118 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:47.998358 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:47.998552 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:47.999540 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.001084 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.003753 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.005175 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.005296 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.005508 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.006092 (+ 584us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.006256 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10792,"thread_start_us":10971,"threads_started":1}
I20260810 03:15:48.006815 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.985534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:40841 (local address 127.0.0.1:54190)
0810 03:15:47.997663 (+ 12129us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:47.997681 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:47.997874 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:47.998851 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:47.998859 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:47.998891 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:47.999313 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:47.999325 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.001279 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.001283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.003618 (+ 2335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.003630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.005655 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.005662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.005845 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.005893 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 03:15:48.006028 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 03:15:48.006263 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12002,"mutex_wait_us":48,"thread_start_us":10444,"threads_started":1}
I20260810 03:15:48.009052 8832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.985335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:44359 (local address 127.0.0.1:41720)
0810 03:15:47.996339 (+ 11004us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:47.996372 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:47.996515 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:48.001351 (+ 4836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:48.001356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:48.001385 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:48.001856 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.001869 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.004446 (+ 2577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.004451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.006389 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.006407 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.008178 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.008184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.008468 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.008501 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:15:48.008581 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:15:48.008710 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10784,"mutex_wait_us":40,"thread_start_us":12434,"threads_started":1}
I20260810 03:15:48.009120 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.985502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41720 (local address 127.18.112.67:44359)
0810 03:15:48.000697 (+ 15195us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.000704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.000730 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:15:48.000809 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.000816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.000991 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.002042 (+ 1051us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:48.002318 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.004337 (+ 2019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.006571 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.007926 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.008350 (+ 424us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.008565 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.008631 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.008775 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15043,"thread_start_us":15617,"threads_started":1}
I20260810 03:15:48.011241 8525 tablet_service.cc:1467] Processing CreateTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 (DEFAULT_TABLE table=test-table [id=05ec021196c74b8bb91dc8afcbcf54eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:48.012750 8525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:48.012601 8713 tablet_service.cc:1467] Processing CreateTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 (DEFAULT_TABLE table=test-table [id=05ec021196c74b8bb91dc8afcbcf54eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:48.013922 8713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:48.016860 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.998134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57488)
0810 03:15:48.003163 (+ 5029us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.003180 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:48.003304 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:48.003860 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:48.003864 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:48.003890 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:48.004232 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.004244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.006011 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.006016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.008461 (+ 2445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.008477 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.016113 (+ 7636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.016120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.016282 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.016305 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:15:48.016376 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 03:15:48.016489 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4898,"mutex_wait_us":42,"thread_start_us":4755,"threads_started":1}
I20260810 03:15:48.016908 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:47.996932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.18.112.65:42915)
0810 03:15:48.001466 (+ 4534us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.001474 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.003275 (+ 1801us) server_negotiation.cc:407] Connection header received
0810 03:15:48.003472 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.003480 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.003671 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.003886 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:48.004403 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.005853 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.008648 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.015903 (+ 7255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.016031 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.016220 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.016459 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.016608 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4407,"thread_start_us":4308,"threads_started":1}
I20260810 03:15:48.020339 8328 tablet_service.cc:1467] Processing CreateTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 (DEFAULT_TABLE table=test-table [id=05ec021196c74b8bb91dc8afcbcf54eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:15:48.021605 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:15:48.025364 8837 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Bootstrap starting.
I20260810 03:15:48.028842 8837 tablet_bootstrap.cc:654] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:48.028980 8838 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Bootstrap starting.
I20260810 03:15:48.030222 8837 log.cc:824] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:48.032331 8838 tablet_bootstrap.cc:654] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:48.033438 8838 log.cc:824] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:48.034307 8837 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: No bootstrap required, opened a new log
I20260810 03:15:48.034621 8837 ts_tablet_manager.cc:1397] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260810 03:15:48.035960 8848 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Bootstrap starting.
I20260810 03:15:48.036370 8838 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: No bootstrap required, opened a new log
I20260810 03:15:48.036608 8838 ts_tablet_manager.cc:1397] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:15:48.038517 8848 tablet_bootstrap.cc:654] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Neither blocks nor log segments found. Creating new log.
I20260810 03:15:48.039439 8848 log.cc:824] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:48.044986 8837 raft_consensus.cc:348] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.045405 8837 raft_consensus.cc:374] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:48.045504 8837 raft_consensus.cc:729] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376bc0104e3940908a8e8539837a3afe, State: Initialized, Role: FOLLOWER
I20260810 03:15:48.045758 8848 tablet_bootstrap.cc:492] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: No bootstrap required, opened a new log
I20260810 03:15:48.046038 8848 ts_tablet_manager.cc:1397] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20260810 03:15:48.046078 8837 consensus_queue.cc:260] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.046631 8838 raft_consensus.cc:348] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.047076 8838 raft_consensus.cc:374] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:48.047169 8620 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:48.047189 8838 raft_consensus.cc:729] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdc792f5d554089ad213b3e80cc5bff, State: Initialized, Role: FOLLOWER
I20260810 03:15:48.047905 8837 ts_tablet_manager.cc:1428] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260810 03:15:48.047749 8838 consensus_queue.cc:260] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.049409 8838 ts_tablet_manager.cc:1428] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260810 03:15:48.050709 8816 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:48.056746 8848 raft_consensus.cc:348] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.057055 8848 raft_consensus.cc:374] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:15:48.057152 8848 raft_consensus.cc:729] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab4c0c7f3574a3586953555861e8e53, State: Initialized, Role: FOLLOWER
I20260810 03:15:48.057621 8848 consensus_queue.cc:260] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.058656 8434 heartbeater.cc:503] Master 127.18.112.126:44203 was elected leader, sending a full tablet report...
I20260810 03:15:48.059080 8848 ts_tablet_manager.cc:1428] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Time spent starting tablet: real 0.013s user 0.009s sys 0.000s
I20260810 03:15:48.118101 8852 raft_consensus.cc:482] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:15:48.118373 8852 raft_consensus.cc:504] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.119844 8852 leader_election.cc:288] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841), 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:48.126000 8834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.120244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:55997 (local address 127.18.112.66:40841)
0810 03:15:48.120407 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.120412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.120430 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:15:48.120636 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.120642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.120720 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.120812 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:48.121394 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.122344 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.124203 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.125192 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.125314 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.125367 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.125674 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.125763 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:15:48.126044 8818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.120166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:40841 (local address 127.18.112.67:55997)
0810 03:15:48.120348 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.120366 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:48.120483 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:48.121009 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:48.121013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:48.121040 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:48.121229 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.121238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.122480 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.122486 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.124030 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.124042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.125335 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.125341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.125522 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.125558 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:15:48.125656 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 03:15:48.125781 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":6}
I20260810 03:15:48.126607 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.120728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:43799 (local address 127.18.112.65:42915)
0810 03:15:48.120907 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.120912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.121302 (+ 390us) server_negotiation.cc:407] Connection header received
0810 03:15:48.121443 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.121447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.121499 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.121557 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:15:48.122079 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.122971 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.124789 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.125695 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.125828 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.125894 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.126258 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.126383 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:15:48.127079 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.120517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.18.112.67:43799)
0810 03:15:48.121205 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.121223 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:15:48.121324 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:15:48.121592 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:15:48.121596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:15:48.121620 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:15:48.121943 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.121954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.123112 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.123115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.124638 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:15:48.124653 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.125884 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.125891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:15:48.126061 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.126092 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:15:48.126763 (+ 671us) client_negotiation.cc:240] Negotiation successful
0810 03:15:48.126861 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":353,"threads_started":1}
I20260810 03:15:48.127027 8555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bb0f51a4d84b21ab9c4bd07501a7e2" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376bc0104e3940908a8e8539837a3afe" is_pre_election: true
I20260810 03:15:48.127534 8555 raft_consensus.cc:2454] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 0.
I20260810 03:15:48.128134 8651 leader_election.cc:302] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdc792f5d554089ad213b3e80cc5bff, 376bc0104e3940908a8e8539837a3afe; no voters:
I20260810 03:15:48.128046 8363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bb0f51a4d84b21ab9c4bd07501a7e2" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab4c0c7f3574a3586953555861e8e53" is_pre_election: true
I20260810 03:15:48.128461 8852 raft_consensus.cc:2781] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:15:48.128494 8363 raft_consensus.cc:2454] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 0.
I20260810 03:15:48.128613 8852 raft_consensus.cc:482] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:15:48.128708 8852 raft_consensus.cc:3037] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:48.131081 8852 raft_consensus.cc:504] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.131668 8852 leader_election.cc:288] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 election: Requested vote from peers 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841), 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915)
I20260810 03:15:48.132006 8555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bb0f51a4d84b21ab9c4bd07501a7e2" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "376bc0104e3940908a8e8539837a3afe"
I20260810 03:15:48.132196 8555 raft_consensus.cc:3037] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:48.132181 8363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6bb0f51a4d84b21ab9c4bd07501a7e2" candidate_uuid: "1bdc792f5d554089ad213b3e80cc5bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ab4c0c7f3574a3586953555861e8e53"
I20260810 03:15:48.132341 8363 raft_consensus.cc:3037] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:15:48.134300 8555 raft_consensus.cc:2454] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 1.
I20260810 03:15:48.134436 8363 raft_consensus.cc:2454] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdc792f5d554089ad213b3e80cc5bff in term 1.
I20260810 03:15:48.134636 8651 leader_election.cc:302] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdc792f5d554089ad213b3e80cc5bff, 376bc0104e3940908a8e8539837a3afe; no voters:
I20260810 03:15:48.134927 8852 raft_consensus.cc:2781] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:15:48.135340 8852 raft_consensus.cc:686] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 LEADER]: Becoming Leader. State: Replica: 1bdc792f5d554089ad213b3e80cc5bff, State: Running, Role: LEADER
I20260810 03:15:48.135785 8852 consensus_queue.cc:237] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } }
I20260810 03:15:48.139556 8132 catalog_manager.cc:5495] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67). New cstate: current_term: 1 leader_uuid: "1bdc792f5d554089ad213b3e80cc5bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bdc792f5d554089ad213b3e80cc5bff" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 } health_report { overall_health: UNKNOWN } } }
W20260810 03:15:48.185933 8817 tablet.cc:2369] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:15:48.188328 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.183354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41736 (local address 127.18.112.67:44359)
0810 03:15:48.183505 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.183509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.183540 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:15:48.183706 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.183710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.183790 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.183930 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:15:48.184225 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.184905 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.186478 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.186903 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.186991 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.187407 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:15:48.187912 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:15:48.188010 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.188085 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.188150 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:15:48.195423 8363 raft_consensus.cc:1261] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Refusing update from remote peer 1bdc792f5d554089ad213b3e80cc5bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:48.195448 8555 raft_consensus.cc:1261] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Refusing update from remote peer 1bdc792f5d554089ad213b3e80cc5bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:15:48.196282 8855 consensus_queue.cc:1035] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "376bc0104e3940908a8e8539837a3afe" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:48.196585 8852 consensus_queue.cc:1035] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ab4c0c7f3574a3586953555861e8e53" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 42915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:15:48.208295 8862 mvcc.cc:205] Tried to move back new op lower bound from 7316814840599990272 to 7316814840367869952. Current Snapshot: MvccSnapshot[applied={T|T < 7316814840599990272}]
I20260810 03:15:48.218657 8132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:48.218869 8132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:15:48.222291 8132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Sending DeleteTablet for 3 replicas of tablet f6bb0f51a4d84b21ab9c4bd07501a7e2
I20260810 03:15:48.223382 8525 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:48 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:54190
I20260810 03:15:48.223531 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 8195
I20260810 03:15:48.223539 8713 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:48 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:41720
I20260810 03:15:48.224202 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:15:48 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:57488
I20260810 03:15:48.230628 8875 tablet_replica.cc:330] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: stopping tablet replica
I20260810 03:15:48.231086 8875 raft_consensus.cc:2229] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:48.231683 8875 raft_consensus.cc:2258] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:48.233366 8874 tablet_replica.cc:330] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: stopping tablet replica
I20260810 03:15:48.234040 8874 raft_consensus.cc:2229] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:15:48.234800 8874 raft_consensus.cc:2258] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:48.235443 8872 tablet_replica.cc:330] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: stopping tablet replica
I20260810 03:15:48.235837 8872 raft_consensus.cc:2229] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:15:48.236991 8875 ts_tablet_manager.cc:1905] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:48.237203 8872 raft_consensus.cc:2258] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:15:48.238562 8874 ts_tablet_manager.cc:1905] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:48.243151 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.225072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57494 (local address 127.18.112.65:42915)
0810 03:15:48.225256 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.225262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.225284 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:15:48.225412 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.225417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.225495 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.225598 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:48.227302 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.228524 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.231879 (+ 3355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.232593 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.232717 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.236294 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:48.236305 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:48.236319 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:48.236356 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:48.239981 (+ 3625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.240831 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.240839 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.240842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.240987 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.241408 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.241413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.241417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.241908 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:48.242211 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.242557 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.242795 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:15:48.244053 8429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:48.244098 8875 ts_tablet_manager.cc:1918] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:48.244242 8875 log.cc:1196] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/f6bb0f51a4d84b21ab9c4bd07501a7e2
I20260810 03:15:48.244702 8872 ts_tablet_manager.cc:1905] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:48.248315 8874 ts_tablet_manager.cc:1918] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:48.248541 8874 log.cc:1196] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/f6bb0f51a4d84b21ab9c4bd07501a7e2
I20260810 03:15:48.249176 8874 ts_tablet_manager.cc:1939] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 1bdc792f5d554089ad213b3e80cc5bff: Deleting consensus metadata
I20260810 03:15:48.251030 8107 catalog_manager.cc:4841] TS 1bdc792f5d554089ad213b3e80cc5bff (127.18.112.67:44359): tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 (table test-table [id=05ec021196c74b8bb91dc8afcbcf54eb]) successfully deleted
I20260810 03:15:48.251261 8872 ts_tablet_manager.cc:1918] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:48.251394 8872 log.cc:1196] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/f6bb0f51a4d84b21ab9c4bd07501a7e2
I20260810 03:15:48.252720 8872 ts_tablet_manager.cc:1939] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 376bc0104e3940908a8e8539837a3afe: Deleting consensus metadata
I20260810 03:15:48.254948 8109 catalog_manager.cc:4841] TS 376bc0104e3940908a8e8539837a3afe (127.18.112.66:40841): tablet f6bb0f51a4d84b21ab9c4bd07501a7e2 (table test-table [id=05ec021196c74b8bb91dc8afcbcf54eb]) successfully deleted
I20260810 03:15:48.338207 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 8195
I20260810 03:15:48.338227 8875 ts_tablet_manager.cc:1939] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Deleting consensus metadata
I20260810 03:15:48.359690 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 8439
W20260810 03:15:48.359731 8109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.112.65:42915 (error 108)
I20260810 03:15:48.361845 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.361324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57502)
0810 03:15:48.361543 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.361671 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260810 03:15:48.362146 8109 catalog_manager.cc:4584] TS 0ab4c0c7f3574a3586953555861e8e53 (127.18.112.65:42915): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f6bb0f51a4d84b21ab9c4bd07501a7e2: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
I20260810 03:15:48.373880 8834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.361035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54196 (local address 127.18.112.66:40841)
0810 03:15:48.361210 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.361216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.361235 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:15:48.361300 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.361306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.361388 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.361498 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:48.363199 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.364075 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.365379 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.365786 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.365892 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.368490 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:48.368505 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:48.368526 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:48.368563 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:48.371231 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.371938 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.371947 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.371951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.372073 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.372419 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.372424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.372428 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.372778 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:48.373058 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.373367 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.373574 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:15:48.374519 8614 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:48.415787 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.415250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57514)
0810 03:15:48.415478 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.415604 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 03:15:48.416958 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.416540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57518)
0810 03:15:48.416708 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.416819 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 03:15:48.465610 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 8439
I20260810 03:15:48.477653 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.477161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57534)
0810 03:15:48.477344 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.477439 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 03:15:48.478943 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.478552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57550)
0810 03:15:48.478737 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.478812 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260810 03:15:48.488245 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 8623
I20260810 03:15:48.502198 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.489125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41748 (local address 127.18.112.67:44359)
0810 03:15:48.489295 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:15:48.489301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:15:48.489319 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:15:48.489377 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:15:48.489381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:15:48.489441 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:15:48.489543 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:15:48.490873 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.491711 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.493066 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:15:48.493536 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:15:48.493646 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:15:48.496369 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:15:48.496381 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:15:48.496396 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:15:48.496446 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:15:48.499257 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.499992 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.499999 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.500001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.500179 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:15:48.500580 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:15:48.500584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:15:48.500586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:15:48.500919 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:15:48.501198 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0810 03:15:48.501509 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 03:15:48.501730 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:15:48.502818 8806 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:48.560585 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.560036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57560)
0810 03:15:48.560274 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.560394 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 03:15:48.561939 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.561377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57568)
0810 03:15:48.561677 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.561782 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260810 03:15:48.641821 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 8623
I20260810 03:15:48.668466 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 8085
I20260810 03:15:48.669554 8186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:15:48.781560 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:48.780935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:42915 (local address 127.0.0.1:57576)
0810 03:15:48.781167 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:48.781279 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:42915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 03:15:48.781766 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 8085
I20260810 03:15:48.808806 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--webserver_interface=127.18.112.126
--webserver_port=44085
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:44203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:49.128918 8882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:49.129199 8882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:49.129333 8882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:49.136302 8882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:15:49.136410 8882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:49.136488 8882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:49.136564 8882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:15:49.136626 8882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:15:49.145917 8882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:44203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:44203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=44085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:49.147123 8882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:49.148381 8882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:49.159494 8893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:49.159546 8897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:49.159713 8889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:49.160296 8882 server_base.cc:1034] running on GCE node
I20260810 03:15:49.161022 8882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:49.162288 8882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:49.163486 8882 hybrid_clock.cc:648] HybridClock initialized: now 1786331749163435 us; error 35 us; skew 500 ppm
I20260810 03:15:49.163825 8882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:49 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:49.166682 8882 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:15:49.168030 8882 webserver.cc:460] Webserver started at http://127.18.112.126:44085/ using document root <none> and password file <none>
I20260810 03:15:49.168648 8882 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:49.168767 8882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:49.173763 8882 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:15:49.176384 8910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:49.177536 8882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:15:49.177702 8882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "71546b7631e94cacb34728cf81ef7f86"
format_stamp: "Formatted at 2026-08-10 03:15:43 on dist-test-slave-jlzn"
server_key: "d0812906563fcc6fab655c9b9d3deff7"
server_key_iv: "985fc867c6841e7a15edfb8c73985e4d"
server_key_version: "encryptionkey@0"
I20260810 03:15:49.178599 8882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:49.192219 8882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:49.195708 8882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:49.195958 8882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:49.212836 8882 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:44203
I20260810 03:15:49.212855 8991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:44203 every 8 connection(s)
I20260810 03:15:49.214160 8882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:15:49.220521 8992 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:15:49.221516 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8882
I20260810 03:15:49.222283 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:42915
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=38961
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:49.223699 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap starting.
I20260810 03:15:49.246197 8992 log.cc:824] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Log is configured to *not* fsync() on all Append() calls
I20260810 03:15:49.266892 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:15:49.267493 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86: Bootstrap complete.
I20260810 03:15:49.280177 8992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:49.281018 8992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Initialized, Role: FOLLOWER
I20260810 03:15:49.281561 8992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:49.281791 8992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:15:49.281910 8992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:15:49.282090 8992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:15:49.285890 8992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:49.286334 8992 leader_election.cc:302] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71546b7631e94cacb34728cf81ef7f86; no voters:
I20260810 03:15:49.286927 8992 leader_election.cc:288] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 03:15:49.287124 8996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 03:15:49.288115 8996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [term 3 LEADER]: Becoming Leader. State: Replica: 71546b7631e94cacb34728cf81ef7f86, State: Running, Role: LEADER
I20260810 03:15:49.288779 8992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:15:49.288813 8996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } }
I20260810 03:15:49.296005 9001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:49.296356 9001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:49.296862 9004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71546b7631e94cacb34728cf81ef7f86. Latest consensus state: current_term: 3 leader_uuid: "71546b7631e94cacb34728cf81ef7f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71546b7631e94cacb34728cf81ef7f86" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 44203 } } }
I20260810 03:15:49.297184 9004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71546b7631e94cacb34728cf81ef7f86 [sys.catalog]: This master's current role is: LEADER
I20260810 03:15:49.302837 9011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:15:49.315898 9011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:15:49.317408 9011 catalog_manager.cc:1259] Loaded cluster ID: 8501782f24f94216b52c989fd0c963b5
I20260810 03:15:49.317569 9011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 03:15:49.319531 9011 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f664700b9ad google::LogMessage::Fail() at ??:0
@ 0x7f664700e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f664700b4de google::LogMessage::Flush() at ??:0
@ 0x7f664700ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f665ca3e512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f665ca3b976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f665cac3610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f665cac3439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6649c57345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6649c5a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6649c5a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6649c35eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f664cf0f6db start_thread at ??:0
@ 0x7f6645ea561f clone at ??:0
W20260810 03:15:49.626740 8994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:49.626982 8994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:49.627118 8994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:49.634199 8994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:49.634310 8994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:49.634464 8994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:15:49.643713 8994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:42915
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=38961
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:49.644822 8994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:49.646024 8994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:49.658097 9060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:49.658157 9064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:49.658157 9061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:49.659206 8994 server_base.cc:1034] running on GCE node
I20260810 03:15:49.659718 8994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:49.660537 8994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:49.661712 8994 hybrid_clock.cc:648] HybridClock initialized: now 1786331749661663 us; error 45 us; skew 500 ppm
I20260810 03:15:49.661978 8994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:49 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:49.664866 8994 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:15:49.666124 8994 webserver.cc:460] Webserver started at http://127.18.112.65:38961/ using document root <none> and password file <none>
I20260810 03:15:49.666738 8994 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:49.666855 8994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:49.671772 8994 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:15:49.674288 9077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:49.675459 8994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:15:49.675603 8994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "0ab4c0c7f3574a3586953555861e8e53"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "4390a0035dbc7a69ecb5d7923732911a"
server_key_iv: "af2c203450313b7c2b6e79d310d1717a"
server_key_version: "encryptionkey@0"
I20260810 03:15:49.676528 8994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:49.690155 8994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:49.693603 8994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:49.693847 8994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:49.694707 8994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:49.696316 9086 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260810 03:15:49.701140 9086 ts_tablet_manager.cc:1852] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260810 03:15:49.702068 9086 ts_tablet_manager.cc:1905] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:15:49.708895 9086 ts_tablet_manager.cc:1918] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:15:49.709142 9086 ts_tablet_manager.cc:1939] T f6bb0f51a4d84b21ab9c4bd07501a7e2 P 0ab4c0c7f3574a3586953555861e8e53: Deleting consensus metadata
I20260810 03:15:49.709614 8994 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260810 03:15:49.709725 8994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.000s sys 0.000s
I20260810 03:15:49.709836 8994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:49.709908 8994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:49.740795 8994 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:42915
I20260810 03:15:49.740845 9248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:42915 every 8 connection(s)
I20260810 03:15:49.741992 8994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:15:49.742552 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 8994
I20260810 03:15:49.743384 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:40841
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=35979
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:15:49.746955 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:49.745173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:40697)
0810 03:15:49.745932 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:49.746184 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":316,"threads_started":1}
W20260810 03:15:49.747483 9250 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:44203 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:44203: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
I20260810 03:15:49.748263 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:49.747962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:55523)
0810 03:15:49.748089 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:49.748162 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 03:15:49.749028 9252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:49.748740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:59835)
0810 03:15:49.748851 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:49.748920 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 03:15:49.749238 9250 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:15:50.059952 9256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:50.060217 9256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:50.060352 9256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:50.067247 9256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:50.067351 9256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:50.067494 9256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:15:50.076563 9256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:40841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=35979
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:50.077658 9256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:50.078848 9256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:50.090893 9266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:50.090920 9267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:50.090971 9271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:50.092172 9256 server_base.cc:1034] running on GCE node
I20260810 03:15:50.092693 9256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:50.093468 9256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:50.094653 9256 hybrid_clock.cc:648] HybridClock initialized: now 1786331750094600 us; error 43 us; skew 500 ppm
I20260810 03:15:50.094901 9256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:50 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331750, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:50.097749 9256 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:15:50.098963 9256 webserver.cc:460] Webserver started at http://127.18.112.66:35979/ using document root <none> and password file <none>
I20260810 03:15:50.099534 9256 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:50.099628 9256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:50.104487 9256 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:15:50.107324 9280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.108651 9256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:15:50.108783 9256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "376bc0104e3940908a8e8539837a3afe"
format_stamp: "Formatted at 2026-08-10 03:15:44 on dist-test-slave-jlzn"
server_key: "a7748e0696a7b5b02f9057823771e22c"
server_key_iv: "064dd2f456e29a19834b5c8043c71895"
server_key_version: "encryptionkey@0"
I20260810 03:15:50.109745 9256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:50.123399 9256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:50.127002 9256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:50.127233 9256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:50.128124 9256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:50.129314 9256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:50.129407 9256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.129482 9256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:50.129535 9256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.158731 9256 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:40841
I20260810 03:15:50.158789 9457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:40841 every 8 connection(s)
I20260810 03:15:50.160133 9256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:15:50.164650 9463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.162897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:39681)
0810 03:15:50.163580 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.163791 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":254,"threads_started":1}
W20260810 03:15:50.165225 9459 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:44203 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:44203: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
I20260810 03:15:50.165939 9463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.165662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:46575)
0810 03:15:50.165779 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.165843 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 03:15:50.166627 9463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.166360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:42301)
0810 03:15:50.166458 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.166526 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 03:15:50.166827 9459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:15:50.167608 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 9256
I20260810 03:15:50.168257 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:44359
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:44203
--webserver_port=45113
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:15:50.477725 9464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:15:50.477962 9464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:15:50.478057 9464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:15:50.484874 9464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:15:50.484962 9464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:15:50.485095 9464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:15:50.494055 9464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:44359
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=45113
--tserver_master_addrs=127.18.112.126:44203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:15:50.495050 9464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:15:50.496201 9464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:15:50.508199 9477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:50.508249 9474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:15:50.508656 9473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:15:50.508972 9464 server_base.cc:1034] running on GCE node
I20260810 03:15:50.509572 9464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:15:50.510390 9464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:15:50.511579 9464 hybrid_clock.cc:648] HybridClock initialized: now 1786331750511534 us; error 39 us; skew 500 ppm
I20260810 03:15:50.511890 9464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:15:50 dist-test-slave-jlzn krb5kdc[7249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331750, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:15:50.517504 9464 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:15:50.518800 9464 webserver.cc:460] Webserver started at http://127.18.112.67:45113/ using document root <none> and password file <none>
I20260810 03:15:50.519409 9464 fs_manager.cc:359] Metadata directory not provided
I20260810 03:15:50.519526 9464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:15:50.524319 9464 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:15:50.526698 9486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.527890 9464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:15:50.528039 9464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "1bdc792f5d554089ad213b3e80cc5bff"
format_stamp: "Formatted at 2026-08-10 03:15:45 on dist-test-slave-jlzn"
server_key: "d06407cc86db56f84c57d1643c71f317"
server_key_iv: "f030c77d9db4b4974dce3b5be6de7e52"
server_key_version: "encryptionkey@0"
I20260810 03:15:50.528921 9464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:15:50.543248 9464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:15:50.546538 9464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:15:50.546778 9464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:15:50.547621 9464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:15:50.548846 9464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:15:50.548938 9464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.549044 9464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:15:50.549125 9464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:15:50.578111 9464 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:44359
I20260810 03:15:50.578179 9651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:44359 every 8 connection(s)
I20260810 03:15:50.579457 9464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:15:50.581465 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 9464
I20260810 03:15:50.584103 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.582127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:39215)
0810 03:15:50.582962 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.583223 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":309,"threads_started":1}
W20260810 03:15:50.584666 9652 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:44203 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:44203: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
I20260810 03:15:50.585350 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.585064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:50337)
0810 03:15:50.585188 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.585252 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 03:15:50.586026 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.585764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:42077)
0810 03:15:50.585862 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.585930 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 03:15:50.586218 9652 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:15:50.750375 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:50.749684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:33783)
0810 03:15:50.750085 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:50.750160 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":190,"threads_started":1}
I20260810 03:15:51.168020 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:51.167256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:33695)
0810 03:15:51.167656 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:51.167776 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":190,"threads_started":1}
I20260810 03:15:51.587423 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:51.586666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:33099)
0810 03:15:51.587096 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:51.587218 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":214,"threads_started":1}
I20260810 03:15:51.751868 9665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:51.751115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:43735)
0810 03:15:51.751539 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:51.751639 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":224,"threads_started":1}
I20260810 03:15:52.169440 9666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:52.168755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:50517)
0810 03:15:52.169201 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:52.169284 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":221,"threads_started":1}
I20260810 03:15:52.588882 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:52.588212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:55661)
0810 03:15:52.588650 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:52.588725 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":214,"threads_started":1}
I20260810 03:15:52.753307 9668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:52.752644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:44863)
0810 03:15:52.753068 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:52.753152 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":212,"threads_started":1}
I20260810 03:15:53.170806 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:53.170169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:55333)
0810 03:15:53.170569 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:53.170644 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":208,"threads_started":1}
I20260810 03:15:53.590267 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:53.589598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:45449)
0810 03:15:53.590019 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:53.590095 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":218,"threads_started":1}
I20260810 03:15:53.754812 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:53.754063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:45431)
0810 03:15:53.754537 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:53.754621 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":228,"threads_started":1}
I20260810 03:15:54.172230 9674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:54.171530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:47829)
0810 03:15:54.171971 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:54.172049 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":208,"threads_started":1}
I20260810 03:15:54.591670 9676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:54.590988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:50627)
0810 03:15:54.591392 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:54.591468 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":180,"threads_started":1}
I20260810 03:15:54.756230 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:54.755580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:40191)
0810 03:15:54.756000 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:54.756074 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":218,"threads_started":1}
I20260810 03:15:55.173687 9678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:55.173004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:45155)
0810 03:15:55.173448 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:55.173525 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":225,"threads_started":1}
I20260810 03:15:55.593118 9680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:55.592430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:52779)
0810 03:15:55.592886 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:55.592961 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":236,"threads_started":1}
I20260810 03:15:55.757855 9682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:55.757038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:56455)
0810 03:15:55.757534 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:55.757633 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":255,"threads_started":1}
I20260810 03:15:56.175069 9683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:56.174425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:48947)
0810 03:15:56.174835 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:56.174920 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":203,"threads_started":1}
I20260810 03:15:56.594508 9685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:56.593872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:46141)
0810 03:15:56.594276 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:56.594359 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":211,"threads_started":1}
I20260810 03:15:56.759351 9687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:56.758603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:56031)
0810 03:15:56.759074 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:56.759159 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":208,"threads_started":1}
I20260810 03:15:57.176692 9688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:57.175900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:42363)
0810 03:15:57.176412 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:57.176487 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":238,"threads_started":1}
I20260810 03:15:57.596016 9689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:57.595270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:52133)
0810 03:15:57.595705 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:57.595783 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":189,"threads_started":1}
I20260810 03:15:57.760711 9691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:57.760081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:34833)
0810 03:15:57.760465 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:57.760539 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":200,"threads_started":1}
I20260810 03:15:58.178088 9692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:58.177448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:56793)
0810 03:15:58.177852 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:58.177929 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":211,"threads_started":1}
I20260810 03:15:58.597404 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:58.596753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:46639)
0810 03:15:58.597177 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:58.597252 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":219,"threads_started":1}
I20260810 03:15:58.762254 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:58.761498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:49709)
0810 03:15:58.762002 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:58.762091 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":259,"threads_started":1}
I20260810 03:15:59.179584 9696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:59.178814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:56351)
0810 03:15:59.179324 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:59.179412 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":225,"threads_started":1}
I20260810 03:15:59.598811 9697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:59.598109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:56917)
0810 03:15:59.598575 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:59.598650 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":227,"threads_started":1}
I20260810 03:15:59.763938 9698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:15:59.763097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:38361)
0810 03:15:59.763583 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0810 03:15:59.763689 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":265,"threads_started":1}
I20260810 03:16:00.180987 9699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:00.180348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:48101)
0810 03:16:00.180759 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:00.180835 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":221,"threads_started":1}
I20260810 03:16:00.600205 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:00.599549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:49543)
0810 03:16:00.599976 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:00.600048 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":252,"threads_started":1}
I20260810 03:16:00.765311 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:00.764681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:38397)
0810 03:16:00.765072 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:00.765146 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":206,"threads_started":1}
I20260810 03:16:01.182469 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:01.181777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:45829)
0810 03:16:01.182203 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:01.182291 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":211,"threads_started":1}
I20260810 03:16:01.601606 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:01.600963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:58695)
0810 03:16:01.601358 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:01.601444 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":202,"threads_started":1}
I20260810 03:16:01.766686 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:01.766044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:51507)
0810 03:16:01.766452 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:01.766526 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":225,"threads_started":1}
I20260810 03:16:02.183955 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:02.183252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:53805)
0810 03:16:02.183685 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:02.183765 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":202,"threads_started":1}
I20260810 03:16:02.602998 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:02.602370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:46503)
0810 03:16:02.602776 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:02.602853 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":190,"threads_started":1}
I20260810 03:16:02.768159 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:02.767421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:54217)
0810 03:16:02.767879 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:02.767979 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":219,"threads_started":1}
I20260810 03:16:03.185436 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:03.184730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:46151)
0810 03:16:03.185170 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:03.185257 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":208,"threads_started":1}
I20260810 03:16:03.604502 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:03.603797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:35911)
0810 03:16:03.604245 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:03.604329 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":208,"threads_started":1}
I20260810 03:16:03.769572 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:03.768882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:58305)
0810 03:16:03.769304 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:03.769388 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":198,"threads_started":1}
I20260810 03:16:04.186863 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:04.186185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:52095)
0810 03:16:04.186581 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:04.186668 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":199,"threads_started":1}
I20260810 03:16:04.607430 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:04.606761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:38367)
0810 03:16:04.607170 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:04.607260 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":207,"threads_started":1}
I20260810 03:16:04.771188 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:04.770489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.65:52547)
0810 03:16:04.770917 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:04.771008 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":207,"threads_started":1}
I20260810 03:16:05.188423 9726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:05.187741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.66:37967)
0810 03:16:05.188165 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:05.188253 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":232,"threads_started":1}
I20260810 03:16:05.587494 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 8994
I20260810 03:16:05.609992 9727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:05.588416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46516 (local address 127.18.112.65:42915)
0810 03:16:05.589002 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:05.589022 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:05.589066 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:16:05.590931 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:05.590942 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:05.591408 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:05.591715 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:05.593015 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.594212 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.595324 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.596029 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.596169 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:05.600220 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:05.600230 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:05.600248 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:05.600300 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:05.605915 (+ 5615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.606751 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.606761 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.606770 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.606982 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.607378 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.607383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.607386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.608119 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:05.608433 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:05.608949 (+ 516us) server_negotiation.cc:299] Negotiation successful
0810 03:16:05.609555 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":270,"threads_started":1}
I20260810 03:16:05.611852 9242 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:05.624034 9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:05.608632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:44203 (local address 127.18.112.67:43993)
0810 03:16:05.623684 (+ 15052us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:05.623823 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:44203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14920,"threads_started":1}
I20260810 03:16:05.708916 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 8994
I20260810 03:16:05.732513 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 9256
I20260810 03:16:05.759526 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:05.733450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.18.112.66:40841)
0810 03:16:05.740223 (+ 6773us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:05.740238 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:05.740274 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:16:05.741838 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:05.741848 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:05.742276 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:05.742586 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:05.744179 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.745409 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.746665 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.747324 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.747497 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:05.753665 (+ 6168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:05.753674 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:05.753689 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:05.753732 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:05.756339 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.757011 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.757018 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.757024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.757195 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.757579 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.757583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.757585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.758100 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:05.758391 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:05.758842 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 03:16:05.759241 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6616,"thread_start_us":6477,"threads_started":1}
I20260810 03:16:05.760902 9452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:05.842548 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 9256
I20260810 03:16:05.864814 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 9464
I20260810 03:16:05.881716 9734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:05.865709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44948 (local address 127.18.112.67:44359)
0810 03:16:05.866298 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:05.866312 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:05.866353 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:16:05.867996 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:05.868007 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:05.868428 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:05.868737 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:05.870178 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.871381 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.872848 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:05.873483 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:05.873654 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:05.876134 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:05.876150 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:05.876163 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:05.876204 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:05.878653 (+ 2449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.879269 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.879275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.879281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.879446 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:05.879846 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:05.879850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:05.879852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:05.880341 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:05.880645 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:05.881055 (+ 410us) server_negotiation.cc:299] Negotiation successful
0810 03:16:05.881430 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":261,"threads_started":1}
I20260810 03:16:05.882928 9644 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:05.963119 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 9464
2026-08-10T03:16:05Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (23915 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:16:06 dist-test-slave-jlzn krb5kdc[9741](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:16:06 dist-test-slave-jlzn krb5kdc[9741](info): set up 2 sockets
Aug 10 03:16:06 dist-test-slave-jlzn krb5kdc[9741](info): commencing operation
krb5kdc: starting...
W20260810 03:16:07.143936 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.006s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:16:07 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:16:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:16:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:16:07.368860 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:41347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:07.679770 9769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:07.680047 9769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:07.680142 9769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:07.687071 9769 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:16:07.687155 9769 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:16:07.687197 9769 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:16:07.687247 9769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:16:07.687300 9769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:07.687364 9769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:07.687408 9769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:16:07.687459 9769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:16:07.696715 9769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:41347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:07.697784 9769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:07.698994 9769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:07.709919 9776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:07.710031 9780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:07.710060 9777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:07.710920 9769 server_base.cc:1034] running on GCE node
I20260810 03:16:07.711609 9769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:07.712821 9769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:07.714036 9769 hybrid_clock.cc:648] HybridClock initialized: now 1786331767713975 us; error 37 us; skew 500 ppm
I20260810 03:16:07.714332 9769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:07 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:07.717327 9769 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:16:07.718604 9769 webserver.cc:460] Webserver started at http://127.18.112.126:38127/ using document root <none> and password file <none>
I20260810 03:16:07.719211 9769 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:07.719308 9769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:07.719594 9769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:16:07.722364 9769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "e8b1d4c33b2f46318c815083ad14a50f"
format_stamp: "Formatted at 2026-08-10 03:16:07 on dist-test-slave-jlzn"
server_key: "32653895f4fc4fcc7d471899f948402c"
server_key_iv: "907a2ba92b7d682114b07bc64cb8af9d"
server_key_version: "encryptionkey@0"
I20260810 03:16:07.723085 9769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "e8b1d4c33b2f46318c815083ad14a50f"
format_stamp: "Formatted at 2026-08-10 03:16:07 on dist-test-slave-jlzn"
server_key: "32653895f4fc4fcc7d471899f948402c"
server_key_iv: "907a2ba92b7d682114b07bc64cb8af9d"
server_key_version: "encryptionkey@0"
I20260810 03:16:07.727739 9769 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:16:07.730867 9792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:07.732096 9769 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:16:07.732240 9769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "e8b1d4c33b2f46318c815083ad14a50f"
format_stamp: "Formatted at 2026-08-10 03:16:07 on dist-test-slave-jlzn"
server_key: "32653895f4fc4fcc7d471899f948402c"
server_key_iv: "907a2ba92b7d682114b07bc64cb8af9d"
server_key_version: "encryptionkey@0"
I20260810 03:16:07.732420 9769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:07.748370 9769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:07.752279 9769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:07.752501 9769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:07.768841 9769 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:41347
I20260810 03:16:07.768867 9865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:41347 every 8 connection(s)
I20260810 03:16:07.770023 9769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:16:07.773377 9868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:07.777732 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 9769
I20260810 03:16:07.777915 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:16:07.778621 18881 external_mini_cluster.cc:1428] Setting key 184f12bfded665e6576d32b3d3626a06
I20260810 03:16:07.783349 9868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap starting.
I20260810 03:16:07.786116 9868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:07.787055 9868 log.cc:824] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:07.790364 9868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: No bootstrap required, opened a new log
Aug 10 03:16:07 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:07.799595 9868 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:07.800029 9868 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:07.800138 9868 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Initialized, Role: FOLLOWER
I20260810 03:16:07.800752 9868 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:07.801051 9868 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:16:07.801203 9868 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:16:07.801380 9868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:07.801414 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:07.780424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.18.112.126:41347)
0810 03:16:07.781220 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:07.781230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:07.781271 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:16:07.782884 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:07.782904 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:07.783236 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:07.783559 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:07.785095 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:07.786387 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:07.787907 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:07.788946 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:07.789130 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:07.793310 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:07.793320 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:07.793338 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:07.793390 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:07.797166 (+ 3776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:07.797833 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:07.797841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:07.797852 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:07.798089 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:07.798407 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:07.798412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:07.798415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:07.799065 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:07.799355 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:07.799724 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 03:16:07.800176 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":353,"threads_started":1}
I20260810 03:16:07.804174 9868 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:07.804576 9868 leader_election.cc:302] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b1d4c33b2f46318c815083ad14a50f; no voters:
I20260810 03:16:07.805037 9868 leader_election.cc:288] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:16:07.805166 9877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:16:07.805773 9877 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 LEADER]: Becoming Leader. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Running, Role: LEADER
I20260810 03:16:07.806313 9877 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:07.806824 9868 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:16:07.808997 9879 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:07.809367 9879 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:07.813416 9887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:16:07.813364 9880 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b1d4c33b2f46318c815083ad14a50f. Latest consensus state: current_term: 1 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:07.813759 9880 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:07.818307 9887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:16:07.826853 9887 catalog_manager.cc:1347] Generated new cluster ID: 29ec40bda6e3464a82513a98a1bbdf18
I20260810 03:16:07.826941 9887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:16:07.836236 9887 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:16:07.837970 9887 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:16:07.845074 9887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Generated new TSK 0
I20260810 03:16:07.845732 9887 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:16:07.913164 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:08.226660 9908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:08.226915 9908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:08.227007 9908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:08.233891 9908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:08.233985 9908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:08.234097 9908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:16:08.243258 9908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:08.244359 9908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:08.245481 9908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:08.257498 9920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:08.257488 9914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:08.257519 9917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:08.258203 9908 server_base.cc:1034] running on GCE node
I20260810 03:16:08.258775 9908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:08.259600 9908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:08.260792 9908 hybrid_clock.cc:648] HybridClock initialized: now 1786331768260747 us; error 31 us; skew 500 ppm
I20260810 03:16:08.261070 9908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:08 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331768, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:08.264045 9908 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:16:08.265277 9908 webserver.cc:460] Webserver started at http://127.18.112.65:37785/ using document root <none> and password file <none>
I20260810 03:16:08.265857 9908 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:08.265955 9908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:08.266188 9908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:16:08.268828 9908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "340095afdf18fcfc4083b6e27e43fd2d"
server_key_iv: "d311eec780e7db20a27ec74007d5421f"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.269480 9908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "340095afdf18fcfc4083b6e27e43fd2d"
server_key_iv: "d311eec780e7db20a27ec74007d5421f"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.274046 9908 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 03:16:08.277122 9933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:08.278263 9908 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:16:08.278394 9908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "340095afdf18fcfc4083b6e27e43fd2d"
server_key_iv: "d311eec780e7db20a27ec74007d5421f"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.278537 9908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:08.296865 9908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:08.300582 9908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:08.300798 9908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:08.301599 9908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:08.302726 9908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:08.302796 9908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:08.302882 9908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:08.302924 9908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:08.332360 9908 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44845
I20260810 03:16:08.332420 10119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44845 every 8 connection(s)
I20260810 03:16:08.333477 9908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:16:08.343075 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 9908
I20260810 03:16:08.343307 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:16:08.344017 18881 external_mini_cluster.cc:1428] Setting key 1e2abf85f532d6d66aa99cc85469d707
Aug 10 03:16:08 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331768, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:08.352205 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:08.335721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39333 (local address 127.18.112.126:41347)
0810 03:16:08.336174 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:08.336180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:08.337077 (+ 897us) server_negotiation.cc:407] Connection header received
0810 03:16:08.338790 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:08.338796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:08.338874 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:08.338970 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:08.340420 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.341129 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.342586 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.343183 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.343313 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:08.347055 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:08.347060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:08.347063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:08.347093 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:08.349428 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:08.350188 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:08.350192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:08.350194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:08.350303 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:08.350705 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:08.350707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:08.350709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:08.350949 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:08.351053 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:08.351755 (+ 702us) server_negotiation.cc:299] Negotiation successful
0810 03:16:08.351951 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":228,"threads_started":1}
I20260810 03:16:08.353371 10127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:08.336237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:39333)
0810 03:16:08.336926 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:08.336976 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:08.338541 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:08.339208 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:08.339216 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:08.339690 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:08.340258 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:08.340276 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.341273 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.341277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:08.342448 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:08.342460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.343394 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.343402 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:08.343625 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:08.344289 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:08.344326 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:08.346850 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:08.349559 (+ 2709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:08.349567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:08.349581 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:08.350092 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:08.350389 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:08.350394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:08.350397 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:08.350616 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:08.351058 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:08.351071 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:08.351420 (+ 349us) client_negotiation.cc:769] Sending connection context
0810 03:16:08.351703 (+ 283us) client_negotiation.cc:240] Negotiation successful
0810 03:16:08.352189 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":259,"threads_started":1}
I20260810 03:16:08.354730 10123 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:08.354990 10123 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:08.355646 10123 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:08.357684 9819 ts_manager.cc:194] Registered new tserver with Master: 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845)
I20260810 03:16:08.359380 9819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:39333
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:16:08.401085 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:08.714766 10131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:08.715011 10131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:08.715147 10131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:08.722123 10131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:08.722229 10131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:08.722383 10131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:16:08.731532 10131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:08.732784 10131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:08.734057 10131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:08.746237 10137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:08.746198 10140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:08.746261 10138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:08.747176 10131 server_base.cc:1034] running on GCE node
I20260810 03:16:08.747692 10131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:08.748528 10131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:08.749732 10131 hybrid_clock.cc:648] HybridClock initialized: now 1786331768749690 us; error 43 us; skew 500 ppm
I20260810 03:16:08.750005 10131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:08 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331768, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:08.752956 10131 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:16:08.754173 10131 webserver.cc:460] Webserver started at http://127.18.112.66:41841/ using document root <none> and password file <none>
I20260810 03:16:08.754760 10131 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:08.754880 10131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:08.755131 10131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:16:08.757802 10131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "009027340d694d8b909331e50b3cecde"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "2a1441c7dbfe3ac5d1353fc617ea3af4"
server_key_iv: "e02af1de05642da1d1f652b93cbf7e24"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.758478 10131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "009027340d694d8b909331e50b3cecde"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "2a1441c7dbfe3ac5d1353fc617ea3af4"
server_key_iv: "e02af1de05642da1d1f652b93cbf7e24"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.763203 10131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:16:08.766252 10156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:08.767369 10131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:16:08.767495 10131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "009027340d694d8b909331e50b3cecde"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "2a1441c7dbfe3ac5d1353fc617ea3af4"
server_key_iv: "e02af1de05642da1d1f652b93cbf7e24"
server_key_version: "encryptionkey@0"
I20260810 03:16:08.767639 10131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:08.809355 10131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:08.813108 10131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:08.813360 10131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:08.814244 10131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:08.815573 10131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:08.815685 10131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:08.815826 10131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:08.815887 10131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260810 03:16:08.846925 10131 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:35373
I20260810 03:16:08.846972 10314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:35373 every 8 connection(s)
I20260810 03:16:08.848160 10131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:16:08.854012 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 10131
I20260810 03:16:08.854257 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:16:08.854872 18881 external_mini_cluster.cc:1428] Setting key 003e6bedf1d410effb1f15ec3dc010de
Aug 10 03:16:08 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331768, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:08.869601 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:08.850469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:36837 (local address 127.18.112.126:41347)
0810 03:16:08.850664 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:08.850671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:08.851830 (+ 1159us) server_negotiation.cc:407] Connection header received
0810 03:16:08.853537 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:08.853542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:08.853609 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:08.853696 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:08.855646 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.856637 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.858694 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.859083 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.859176 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:08.862857 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:08.862862 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:08.862865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:08.862898 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:08.866136 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:08.866948 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:08.866954 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:08.866958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:08.867208 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:08.867725 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:08.867730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:08.867733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:08.868095 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:08.868231 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:08.869062 (+ 831us) server_negotiation.cc:299] Negotiation successful
0810 03:16:08.869286 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:16:08.871353 10319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:08.850985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:36837)
0810 03:16:08.851645 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:08.851688 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:08.853297 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:08.853968 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:08.853979 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:08.854717 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:08.855464 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:08.855491 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.856801 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.856805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:08.858543 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:08.858559 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:08.859294 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:08.859301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:08.859561 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:08.860215 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:08.860255 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:08.862653 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:08.866276 (+ 3623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:08.866285 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:08.866299 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:08.866814 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:08.867346 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:08.867350 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:08.867354 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:08.867581 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:08.868299 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:08.868306 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:08.868677 (+ 371us) client_negotiation.cc:769] Sending connection context
0810 03:16:08.869807 (+ 1130us) client_negotiation.cc:240] Negotiation successful
0810 03:16:08.870293 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":271,"threads_started":1}
I20260810 03:16:08.872712 10316 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:08.872967 10316 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:08.873602 10316 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:08.874985 9819 ts_manager.cc:194] Registered new tserver with Master: 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
I20260810 03:16:08.876019 9819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:36837
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:16:08.911751 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:09.220278 10323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:09.220526 10323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:09.220651 10323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:09.227460 10323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:09.227556 10323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:09.227705 10323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:16:09.236744 10323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:09.237815 10323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:09.238971 10323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:09.251128 10330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:09.251101 10331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:09.251291 10335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:09.251878 10323 server_base.cc:1034] running on GCE node
I20260810 03:16:09.252418 10323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:09.253218 10323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:09.254410 10323 hybrid_clock.cc:648] HybridClock initialized: now 1786331769254350 us; error 55 us; skew 500 ppm
I20260810 03:16:09.254688 10323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:09 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:09.257688 10323 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:16:09.258968 10323 webserver.cc:460] Webserver started at http://127.18.112.67:33777/ using document root <none> and password file <none>
I20260810 03:16:09.259572 10323 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:09.259686 10323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:09.259995 10323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:16:09.262689 10323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "38c310a1acd54468992ec768db8663f1"
format_stamp: "Formatted at 2026-08-10 03:16:09 on dist-test-slave-jlzn"
server_key: "f4ca0824a9bb51af9f91005b0b457be1"
server_key_iv: "9f97d369201682a2671efeb66afed163"
server_key_version: "encryptionkey@0"
I20260810 03:16:09.263402 10323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "38c310a1acd54468992ec768db8663f1"
format_stamp: "Formatted at 2026-08-10 03:16:09 on dist-test-slave-jlzn"
server_key: "f4ca0824a9bb51af9f91005b0b457be1"
server_key_iv: "9f97d369201682a2671efeb66afed163"
server_key_version: "encryptionkey@0"
I20260810 03:16:09.268038 10323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260810 03:16:09.271178 10346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:09.272500 10323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:16:09.272646 10323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "38c310a1acd54468992ec768db8663f1"
format_stamp: "Formatted at 2026-08-10 03:16:09 on dist-test-slave-jlzn"
server_key: "f4ca0824a9bb51af9f91005b0b457be1"
server_key_iv: "9f97d369201682a2671efeb66afed163"
server_key_version: "encryptionkey@0"
I20260810 03:16:09.272809 10323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:09.285306 10323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:09.288677 10323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:09.288918 10323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:09.289759 10323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:09.290915 10323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:09.290992 10323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:09.291121 10323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:09.291185 10323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:09.320925 10323 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:34487
I20260810 03:16:09.320971 10507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:34487 every 8 connection(s)
I20260810 03:16:09.322024 10323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:16:09.330288 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 10323
I20260810 03:16:09.330475 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:16:09.331056 18881 external_mini_cluster.cc:1428] Setting key dee0220e83917b85b5bb2a71216f51cb
Aug 10 03:16:09 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:09.341645 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.324283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:39723 (local address 127.18.112.126:41347)
0810 03:16:09.324446 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.324451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.325518 (+ 1067us) server_negotiation.cc:407] Connection header received
0810 03:16:09.327234 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.327240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.327350 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.327436 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:09.328876 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.329635 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.331780 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.332372 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.332496 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.336169 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:09.336176 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:09.336179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:09.336211 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:09.338742 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.339432 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.339438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.339442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.339574 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.340033 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.340038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.340042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.340304 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:09.340442 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.341084 (+ 642us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.341303 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:16:09.342418 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.324698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:39723)
0810 03:16:09.325371 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.325411 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.326988 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.327672 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.327680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.328197 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:09.328713 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.328731 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.329784 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.329788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.331646 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.331658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.332584 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.332592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.332824 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.333526 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:09.333553 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:09.335967 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:09.338873 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:09.338881 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:09.338894 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:09.339297 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:09.339688 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:09.339693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:09.339697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:09.339929 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:09.340432 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:09.340440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:09.340737 (+ 297us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.340970 (+ 233us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.341422 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":264,"threads_started":1}
I20260810 03:16:09.343585 10510 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:09.343860 10510 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:09.344475 10510 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:09.345871 9819 ts_manager.cc:194] Registered new tserver with Master: 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487)
I20260810 03:16:09.346580 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:16:09.346849 9819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:39723
I20260810 03:16:09.362196 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.351090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.18.112.126:41347)
0810 03:16:09.351235 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.351241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.351741 (+ 500us) server_negotiation.cc:407] Connection header received
0810 03:16:09.351890 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.351893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.351949 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.352025 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:09.353376 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.354058 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.355407 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.355825 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.355918 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.357950 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:09.357955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:09.357958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:09.357987 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:09.360191 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.360764 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.360767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.360769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.360883 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.361163 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.361166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.361168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.361451 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:09.361624 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.361849 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.361993 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:16:09.362589 10123 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:09.365775 9819 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41566:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:16:09.372524 9819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:16:09.393108 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.383524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45222 (local address 127.18.112.66:35373)
0810 03:16:09.385014 (+ 1490us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.385023 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.385054 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:16:09.385159 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.385167 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.385393 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.385580 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:09.386219 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.387733 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.390467 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.391896 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.392022 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.392199 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.392634 (+ 435us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.392798 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1351,"thread_start_us":1244,"threads_started":1}
I20260810 03:16:09.393153 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.383452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35373 (local address 127.0.0.1:45222)
0810 03:16:09.384261 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.384309 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.384468 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.385599 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.385605 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.385639 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:09.386014 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.386031 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.387907 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.387913 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.390319 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.390333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.392115 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.392121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.392381 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.392432 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.392574 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.392750 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":1,"thread_start_us":1612,"threads_started":1}
I20260810 03:16:09.394961 10541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.385142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:34487 (local address 127.0.0.1:39398)
0810 03:16:09.386257 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.386273 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.386374 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.388378 (+ 2004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.388382 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.388411 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:09.388830 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.388840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.390601 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.390606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.392651 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.392665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.394162 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.394169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.394325 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.394358 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.394447 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.394564 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":35,"thread_start_us":778,"threads_started":1}
I20260810 03:16:09.395457 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.383510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:57588)
0810 03:16:09.385323 (+ 1813us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.385339 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.385445 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.388010 (+ 2565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.388014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.388040 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:09.388491 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.388507 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.390374 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.390379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.391926 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.391940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.394755 (+ 2815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.394762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.394939 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.394973 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.395050 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.395169 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1695,"mutex_wait_us":24,"thread_start_us":914,"threads_started":1}
I20260810 03:16:09.395771 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.385631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39398 (local address 127.18.112.67:34487)
0810 03:16:09.387852 (+ 2221us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.387860 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.387887 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:16:09.387974 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.387981 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.388179 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.388364 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:09.389004 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.390466 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.392827 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.393974 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.394087 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.394304 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.395295 (+ 991us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.395446 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2067,"thread_start_us":1920,"threads_started":1}
I20260810 03:16:09.396188 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.384106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57588 (local address 127.18.112.65:44845)
0810 03:16:09.387472 (+ 3366us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.387479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.387503 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:16:09.387578 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.387584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.387799 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.388009 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:09.388691 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.390221 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.392108 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.394532 (+ 2424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.394656 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.394871 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.395705 (+ 834us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.395871 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3210,"thread_start_us":3059,"threads_started":1}
I20260810 03:16:09.397178 10223 tablet_service.cc:1467] Processing CreateTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff (DEFAULT_TABLE table=test-table [id=5e7210a19a4b465d9321c3171131b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:09.398379 10223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ceca6808a44d97b7057b6615e7d3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:09.399187 10006 tablet_service.cc:1467] Processing CreateTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff (DEFAULT_TABLE table=test-table [id=5e7210a19a4b465d9321c3171131b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:09.400279 10006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ceca6808a44d97b7057b6615e7d3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:09.403618 10418 tablet_service.cc:1467] Processing CreateTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff (DEFAULT_TABLE table=test-table [id=5e7210a19a4b465d9321c3171131b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:09.404994 10418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ceca6808a44d97b7057b6615e7d3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:09.412488 10543 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Bootstrap starting.
I20260810 03:16:09.415297 10543 tablet_bootstrap.cc:654] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:09.416850 10543 log.cc:824] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:09.418102 10544 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Bootstrap starting.
I20260810 03:16:09.419921 10543 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: No bootstrap required, opened a new log
I20260810 03:16:09.420205 10543 ts_tablet_manager.cc:1397] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:16:09.421422 10544 tablet_bootstrap.cc:654] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:09.422550 10544 log.cc:824] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:09.423355 10547 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Bootstrap starting.
I20260810 03:16:09.426457 10544 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: No bootstrap required, opened a new log
I20260810 03:16:09.426601 10547 tablet_bootstrap.cc:654] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:09.426721 10544 ts_tablet_manager.cc:1397] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 03:16:09.427772 10547 log.cc:824] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:09.428663 10543 raft_consensus.cc:348] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.429140 10543 raft_consensus.cc:374] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:09.429250 10543 raft_consensus.cc:729] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009027340d694d8b909331e50b3cecde, State: Initialized, Role: FOLLOWER
I20260810 03:16:09.429781 10543 consensus_queue.cc:260] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.430764 10547 tablet_bootstrap.cc:492] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: No bootstrap required, opened a new log
I20260810 03:16:09.430743 10316 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:09.431007 10547 ts_tablet_manager.cc:1397] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 03:16:09.431371 10543 ts_tablet_manager.cc:1428] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260810 03:16:09.436368 10544 raft_consensus.cc:348] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.436781 10544 raft_consensus.cc:374] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:09.436882 10544 raft_consensus.cc:729] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509a5bbdd0ad4aec8508ab2c18547a25, State: Initialized, Role: FOLLOWER
I20260810 03:16:09.437441 10544 consensus_queue.cc:260] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.439010 10544 ts_tablet_manager.cc:1428] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent starting tablet: real 0.012s user 0.009s sys 0.005s
I20260810 03:16:09.440310 10547 raft_consensus.cc:348] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.440596 10547 raft_consensus.cc:374] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:09.440693 10547 raft_consensus.cc:729] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c310a1acd54468992ec768db8663f1, State: Initialized, Role: FOLLOWER
I20260810 03:16:09.441180 10547 consensus_queue.cc:260] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.442075 10510 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:09.442507 10547 ts_tablet_manager.cc:1428] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Time spent starting tablet: real 0.011s user 0.003s sys 0.009s
W20260810 03:16:09.573463 10511 tablet.cc:2369] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:16:09.585561 10125 tablet.cc:2369] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:16:09.599974 10317 tablet.cc:2369] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:16:09.601883 10555 raft_consensus.cc:482] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:16:09.602144 10555 raft_consensus.cc:504] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.603832 10555 leader_election.cc:288] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 009027340d694d8b909331e50b3cecde (127.18.112.66:35373), 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845)
I20260810 03:16:09.610723 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.604144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:53013 (local address 127.18.112.66:35373)
0810 03:16:09.604347 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.604354 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.604623 (+ 269us) server_negotiation.cc:407] Connection header received
0810 03:16:09.604816 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.604822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.604899 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.604986 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:09.605363 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.606315 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.608620 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.609809 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.609958 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.610029 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.610342 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.610467 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:16:09.610743 10517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.604196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35373 (local address 127.18.112.67:53013)
0810 03:16:09.604535 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.604550 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.604682 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.605033 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.605037 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.605063 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:09.605216 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.605225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.606453 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.606459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.608447 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.608467 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.609968 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.609974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.610166 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.610202 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.610306 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.610439 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260810 03:16:09.611308 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.604313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:48909 (local address 127.18.112.65:44845)
0810 03:16:09.604515 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.604520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.604910 (+ 390us) server_negotiation.cc:407] Connection header received
0810 03:16:09.605106 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.605112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.605182 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.605247 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:09.605751 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.606695 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.609055 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.610251 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.610394 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.610460 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.610961 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.611086 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:16:09.611951 10557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.604228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.18.112.67:48909)
0810 03:16:09.604809 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:09.604823 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:09.604953 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:09.605289 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:09.605294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:09.605319 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:09.605604 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.605612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.606824 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.606829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.608840 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:09.608854 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.610601 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.610608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:09.610778 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.610815 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:16:09.611465 (+ 650us) client_negotiation.cc:240] Negotiation successful
0810 03:16:09.611609 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":530,"threads_started":1}
I20260810 03:16:09.612174 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ceca6808a44d97b7057b6615e7d3ff" candidate_uuid: "38c310a1acd54468992ec768db8663f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009027340d694d8b909331e50b3cecde" is_pre_election: true
I20260810 03:16:09.612732 10256 raft_consensus.cc:2454] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c310a1acd54468992ec768db8663f1 in term 0.
I20260810 03:16:09.613114 10040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ceca6808a44d97b7057b6615e7d3ff" candidate_uuid: "38c310a1acd54468992ec768db8663f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" is_pre_election: true
I20260810 03:16:09.613545 10040 raft_consensus.cc:2454] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c310a1acd54468992ec768db8663f1 in term 0.
I20260810 03:16:09.613521 10348 leader_election.cc:302] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1; no voters:
I20260810 03:16:09.617518 10555 raft_consensus.cc:2781] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:16:09.617854 10555 raft_consensus.cc:482] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:16:09.617982 10555 raft_consensus.cc:3037] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:09.620523 10555 raft_consensus.cc:504] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.621171 10555 leader_election.cc:288] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [CANDIDATE]: Term 1 election: Requested vote from peers 009027340d694d8b909331e50b3cecde (127.18.112.66:35373), 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845)
I20260810 03:16:09.621548 10256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ceca6808a44d97b7057b6615e7d3ff" candidate_uuid: "38c310a1acd54468992ec768db8663f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009027340d694d8b909331e50b3cecde"
I20260810 03:16:09.621604 10040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ceca6808a44d97b7057b6615e7d3ff" candidate_uuid: "38c310a1acd54468992ec768db8663f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
I20260810 03:16:09.621712 10256 raft_consensus.cc:3037] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:09.621806 10040 raft_consensus.cc:3037] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:09.623791 10256 raft_consensus.cc:2454] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c310a1acd54468992ec768db8663f1 in term 1.
I20260810 03:16:09.623919 10040 raft_consensus.cc:2454] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c310a1acd54468992ec768db8663f1 in term 1.
I20260810 03:16:09.624161 10348 leader_election.cc:302] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1; no voters:
I20260810 03:16:09.624413 10555 raft_consensus.cc:2781] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:16:09.624807 10555 raft_consensus.cc:686] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 1 LEADER]: Becoming Leader. State: Replica: 38c310a1acd54468992ec768db8663f1, State: Running, Role: LEADER
I20260810 03:16:09.625280 10555 consensus_queue.cc:237] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } }
I20260810 03:16:09.629628 9819 catalog_manager.cc:5495] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38c310a1acd54468992ec768db8663f1 (127.18.112.67). New cstate: current_term: 1 leader_uuid: "38c310a1acd54468992ec768db8663f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } health_report { overall_health: HEALTHY } } }
I20260810 03:16:09.685987 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.681069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.18.112.67:34487)
0810 03:16:09.681305 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.681311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.681386 (+ 75us) server_negotiation.cc:407] Connection header received
0810 03:16:09.681543 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.681547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.681617 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.681732 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:16:09.682029 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.682752 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.684207 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.684592 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.684681 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.685078 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:16:09.685523 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:16:09.685633 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.685691 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.685752 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260810 03:16:09.692963 10040 raft_consensus.cc:1261] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Refusing update from remote peer 38c310a1acd54468992ec768db8663f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:16:09.693131 10256 raft_consensus.cc:1261] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Refusing update from remote peer 38c310a1acd54468992ec768db8663f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:16:09.693806 10558 consensus_queue.cc:1035] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:16:09.694139 10555 consensus_queue.cc:1035] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:16:09.704648 10564 mvcc.cc:205] Tried to move back new op lower bound from 7316814928654163968 to 7316814928388395008. Current Snapshot: MvccSnapshot[applied={T|T < 7316814928654163968}]
I20260810 03:16:09.704923 10566 mvcc.cc:205] Tried to move back new op lower bound from 7316814928654163968 to 7316814928388395008. Current Snapshot: MvccSnapshot[applied={T|T < 7316814928654163968}]
I20260810 03:16:09.716894 9819 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:16:09.717170 9819 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:16:09.720618 9819 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Sending DeleteTablet for 3 replicas of tablet 67ceca6808a44d97b7057b6615e7d3ff
I20260810 03:16:09.721683 10223 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:09 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:45222
I20260810 03:16:09.721897 10006 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:09 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:57588
I20260810 03:16:09.721971 10418 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ceca6808a44d97b7057b6615e7d3ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:09 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:39398
I20260810 03:16:09.722422 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 9908
I20260810 03:16:09.722972 10578 tablet_replica.cc:330] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: stopping tablet replica
I20260810 03:16:09.723330 10580 tablet_replica.cc:330] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: stopping tablet replica
I20260810 03:16:09.724162 10578 raft_consensus.cc:2229] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:16:09.724342 10580 raft_consensus.cc:2229] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:16:09.725502 10580 raft_consensus.cc:2258] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:09.725073 10578 raft_consensus.cc:2258] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:09.727607 10580 ts_tablet_manager.cc:1905] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:16:09.734665 10577 tablet_replica.cc:330] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: stopping tablet replica
I20260810 03:16:09.734808 10580 ts_tablet_manager.cc:1918] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:16:09.735010 10580 log.cc:1196] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/67ceca6808a44d97b7057b6615e7d3ff
I20260810 03:16:09.735054 10577 raft_consensus.cc:2229] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:16:09.735606 10577 raft_consensus.cc:2258] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:09.735651 10580 ts_tablet_manager.cc:1939] T 67ceca6808a44d97b7057b6615e7d3ff P 509a5bbdd0ad4aec8508ab2c18547a25: Deleting consensus metadata
I20260810 03:16:09.737470 10578 ts_tablet_manager.cc:1905] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:16:09.737677 10577 ts_tablet_manager.cc:1905] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:16:09.738121 9801 catalog_manager.cc:4841] TS 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845): tablet 67ceca6808a44d97b7057b6615e7d3ff (table test-table [id=5e7210a19a4b465d9321c3171131b699]) successfully deleted
I20260810 03:16:09.743278 10577 ts_tablet_manager.cc:1918] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:16:09.743324 10578 ts_tablet_manager.cc:1918] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:16:09.743405 10577 log.cc:1196] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/67ceca6808a44d97b7057b6615e7d3ff
I20260810 03:16:09.743482 10578 log.cc:1196] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/67ceca6808a44d97b7057b6615e7d3ff
I20260810 03:16:09.743950 10577 ts_tablet_manager.cc:1939] T 67ceca6808a44d97b7057b6615e7d3ff P 009027340d694d8b909331e50b3cecde: Deleting consensus metadata
I20260810 03:16:09.744030 10578 ts_tablet_manager.cc:1939] T 67ceca6808a44d97b7057b6615e7d3ff P 38c310a1acd54468992ec768db8663f1: Deleting consensus metadata
I20260810 03:16:09.745217 9796 catalog_manager.cc:4841] TS 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): tablet 67ceca6808a44d97b7057b6615e7d3ff (table test-table [id=5e7210a19a4b465d9321c3171131b699]) successfully deleted
I20260810 03:16:09.745493 9801 catalog_manager.cc:4841] TS 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): tablet 67ceca6808a44d97b7057b6615e7d3ff (table test-table [id=5e7210a19a4b465d9321c3171131b699]) successfully deleted
Aug 10 03:16:09 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:16:09.755590 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.723630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57604 (local address 127.18.112.65:44845)
0810 03:16:09.723795 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.723857 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.736056 (+ 12199us) server_negotiation.cc:407] Connection header received
0810 03:16:09.736365 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.736370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.736465 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.736543 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:09.739250 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.740350 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.742265 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.742888 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.743016 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.749824 (+ 6808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:09.749834 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:09.749847 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:09.749876 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:09.752817 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.753625 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.753634 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.753636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.753771 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.754134 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.754138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.754140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.754473 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:09.754745 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.755061 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.755259 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:16:09.756258 10111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:09.904947 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 9908
I20260810 03:16:09.929034 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 10131
Aug 10 03:16:09 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:16:09.944940 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:09.929943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.18.112.66:35373)
0810 03:16:09.930159 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:09.930166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:09.930190 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:16:09.930258 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:09.930264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:09.930346 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:09.930469 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:09.931661 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.932873 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.934162 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:09.934778 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:09.934902 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:09.939387 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:09.939401 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:09.939415 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:09.939448 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:09.942131 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.942865 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.942875 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.942883 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.943050 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:09.943449 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:09.943452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:09.943454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:09.943934 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:09.944175 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:09.944476 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 03:16:09.944645 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:16:09.945648 10307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:10.035005 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 10131
I20260810 03:16:10.057687 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 10323
Aug 10 03:16:10 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:16:10.074580 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:10.058433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39412 (local address 127.18.112.67:34487)
0810 03:16:10.058637 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:10.058643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:10.058667 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:16:10.058746 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:10.058751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:10.058842 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:10.058950 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:10.060231 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:10.061436 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:10.062658 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:10.063331 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:10.063481 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:10.067905 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:10.067919 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:10.067938 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:10.067997 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:10.071790 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:10.072445 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:10.072455 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:10.072458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:10.072654 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:10.072971 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:10.072976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:10.072983 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:10.073454 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:10.073782 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:10.073937 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 03:16:10.074168 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:16:10.075392 10502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:10.192929 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 10323
I20260810 03:16:10.217214 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 9769
I20260810 03:16:10.218348 9860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:10.323100 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 9769
I20260810 03:16:30.346719 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--webserver_interface=127.18.112.126
--webserver_port=38127
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:41347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:30.668282 10589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:30.668519 10589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:30.668645 10589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:30.675458 10589 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:16:30.675540 10589 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:16:30.675601 10589 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:16:30.675673 10589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:16:30.675742 10589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:30.675855 10589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:30.675915 10589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:16:30.675994 10589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:16:30.685204 10589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:41347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=38127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:30.686259 10589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:30.687472 10589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:30.710372 10601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:30.710402 10603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:30.710487 10598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:30.711058 10589 server_base.cc:1034] running on GCE node
I20260810 03:16:30.711916 10589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:30.713310 10589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:30.714524 10589 hybrid_clock.cc:648] HybridClock initialized: now 1786331790714465 us; error 37 us; skew 500 ppm
I20260810 03:16:30.714901 10589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:30 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331790, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:30.722048 10589 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:16:30.723479 10589 webserver.cc:460] Webserver started at http://127.18.112.126:38127/ using document root <none> and password file <none>
I20260810 03:16:30.724197 10589 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:30.724303 10589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:30.729801 10589 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:16:30.732491 10610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:30.733721 10589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:16:30.733871 10589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "e8b1d4c33b2f46318c815083ad14a50f"
format_stamp: "Formatted at 2026-08-10 03:16:07 on dist-test-slave-jlzn"
server_key: "32653895f4fc4fcc7d471899f948402c"
server_key_iv: "907a2ba92b7d682114b07bc64cb8af9d"
server_key_version: "encryptionkey@0"
I20260810 03:16:30.734827 10589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:30.749661 10589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:30.753423 10589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:30.753702 10589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:30.770803 10589 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:41347
I20260810 03:16:30.770838 10685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:41347 every 8 connection(s)
I20260810 03:16:30.772549 10589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:16:30.780916 10686 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:16:30.782420 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 10589
I20260810 03:16:30.783465 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:44845
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=37785
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:16:30.784708 10686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap starting.
I20260810 03:16:30.807653 10686 log.cc:824] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:30.824087 10686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:16:30.824721 10686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap complete.
I20260810 03:16:30.838042 10686 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:30.839224 10686 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Initialized, Role: FOLLOWER
I20260810 03:16:30.839931 10686 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:30.840226 10686 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:16:30.840355 10686 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:16:30.840528 10686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:16:30.845844 10686 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:30.846446 10686 leader_election.cc:302] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b1d4c33b2f46318c815083ad14a50f; no voters:
I20260810 03:16:30.847072 10686 leader_election.cc:288] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:16:30.847209 10692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:16:30.848409 10692 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 LEADER]: Becoming Leader. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Running, Role: LEADER
I20260810 03:16:30.848918 10692 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:30.849498 10686 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:16:30.851347 10695 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:30.852218 10695 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:30.851457 10698 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b1d4c33b2f46318c815083ad14a50f. Latest consensus state: current_term: 2 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:30.856033 10698 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:30.856540 10703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:16:30.869374 10703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:16:30.870687 10703 catalog_manager.cc:1259] Loaded cluster ID: 29ec40bda6e3464a82513a98a1bbdf18
I20260810 03:16:30.870774 10703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:16:30.878785 10703 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:16:30.880295 10703 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Loaded TSK: 0
I20260810 03:16:30.917706 10703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Generated new TSK 1
I20260810 03:16:30.918102 10703 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:16:31.144326 10688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:31.144601 10688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:31.144742 10688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:31.151919 10688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:31.152030 10688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:31.152176 10688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:16:31.161545 10688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:44845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=37785
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:31.162744 10688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:31.164016 10688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:31.177524 10740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:31.177543 10744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:31.178165 10739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:31.178273 10688 server_base.cc:1034] running on GCE node
I20260810 03:16:31.178923 10688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:31.179877 10688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:31.181098 10688 hybrid_clock.cc:648] HybridClock initialized: now 1786331791181039 us; error 48 us; skew 500 ppm
I20260810 03:16:31.181389 10688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:31 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331791, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:31.184356 10688 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:16:31.185765 10688 webserver.cc:460] Webserver started at http://127.18.112.65:37785/ using document root <none> and password file <none>
I20260810 03:16:31.186378 10688 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:31.186524 10688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:31.191699 10688 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:16:31.194255 10754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.195477 10688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:16:31.195618 10688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "340095afdf18fcfc4083b6e27e43fd2d"
server_key_iv: "d311eec780e7db20a27ec74007d5421f"
server_key_version: "encryptionkey@0"
I20260810 03:16:31.196561 10688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:31.220257 10688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:31.224188 10688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:31.224421 10688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:31.225315 10688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:31.226552 10688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:31.226653 10688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.226756 10688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:31.226831 10688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.255879 10688 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44845
I20260810 03:16:31.255927 10917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44845 every 8 connection(s)
I20260810 03:16:31.257150 10688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:16:31.257758 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 10688
I20260810 03:16:31.258523 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:35373
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=41841
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:16:31 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331791, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:31.280398 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:31.259962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:38599 (local address 127.18.112.126:41347)
0810 03:16:31.260554 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:31.260568 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:31.261304 (+ 736us) server_negotiation.cc:407] Connection header received
0810 03:16:31.263697 (+ 2393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:31.263709 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:31.264067 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:31.264342 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:31.266134 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.267322 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.269330 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.269913 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.270046 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:31.273531 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:31.273539 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:31.273551 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:31.273596 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:31.276293 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:31.276978 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:31.276985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:31.276990 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:31.277149 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:31.277554 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:31.277558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:31.277560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:31.277983 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:31.278184 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:31.278908 (+ 724us) server_negotiation.cc:299] Negotiation successful
0810 03:16:31.279300 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":249,"threads_started":1}
I20260810 03:16:31.280397 10921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:31.260093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:38599)
0810 03:16:31.261114 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:31.261162 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:31.263232 (+ 2070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:31.264538 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:31.264548 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:31.265232 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:31.265941 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:31.265965 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.267490 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.267495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:31.269206 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:31.269221 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.270141 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.270148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:31.270411 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:31.271034 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:31.271055 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:31.273295 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:31.276423 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:31.276431 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:31.276444 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:31.276844 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:31.277256 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:31.277262 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:31.277265 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:31.277442 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:31.278135 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:31.278143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:31.278445 (+ 302us) client_negotiation.cc:769] Sending connection context
0810 03:16:31.278670 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 03:16:31.279144 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":520,"threads_started":1}
I20260810 03:16:31.283335 10918 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:31.283587 10918 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:31.284264 10918 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:31.286527 10635 ts_manager.cc:194] Registered new tserver with Master: 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845)
I20260810 03:16:31.288633 10635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:38599
W20260810 03:16:31.576013 10922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:31.576267 10922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:31.576362 10922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:31.583235 10922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:31.583334 10922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:31.583446 10922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:16:31.592593 10922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:35373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=41841
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:31.593619 10922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:31.594803 10922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:31.606740 10935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:31.606778 10940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:31.607015 10933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:31.607712 10922 server_base.cc:1034] running on GCE node
I20260810 03:16:31.608258 10922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:31.609073 10922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:31.610273 10922 hybrid_clock.cc:648] HybridClock initialized: now 1786331791610228 us; error 39 us; skew 500 ppm
I20260810 03:16:31.610548 10922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:31 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331791, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:31.613436 10922 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:16:31.614658 10922 webserver.cc:460] Webserver started at http://127.18.112.66:41841/ using document root <none> and password file <none>
I20260810 03:16:31.615255 10922 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:31.615384 10922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:31.620244 10922 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:16:31.622648 10948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.623831 10922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:16:31.623980 10922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "009027340d694d8b909331e50b3cecde"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "2a1441c7dbfe3ac5d1353fc617ea3af4"
server_key_iv: "e02af1de05642da1d1f652b93cbf7e24"
server_key_version: "encryptionkey@0"
I20260810 03:16:31.624848 10922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:31.656563 10922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:31.659967 10922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:31.660207 10922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:31.661051 10922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:31.662241 10922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:31.662338 10922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.662444 10922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:31.662514 10922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:31.691160 10922 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:35373
I20260810 03:16:31.691216 11116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:35373 every 8 connection(s)
I20260810 03:16:31.692490 10922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:16:31.696007 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 10922
I20260810 03:16:31.696702 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:34487
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=33777
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:16:31 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331791, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:31.711884 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:31.694750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:47171 (local address 127.18.112.126:41347)
0810 03:16:31.694961 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:31.694967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:31.696136 (+ 1169us) server_negotiation.cc:407] Connection header received
0810 03:16:31.698035 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:31.698041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:31.698121 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:31.698209 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:31.699679 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.700448 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.701972 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.702552 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.702661 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:31.706486 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:31.706492 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:31.706497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:31.706536 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:31.709046 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:31.709814 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:31.709818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:31.709820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:31.709928 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:31.710334 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:31.710336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:31.710338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:31.710579 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:31.710693 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:31.711438 (+ 745us) server_negotiation.cc:299] Negotiation successful
0810 03:16:31.711615 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:16:31.713056 11120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:31.695221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:47171)
0810 03:16:31.695991 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:31.696032 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:31.697765 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:31.698447 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:31.698454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:31.698946 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:31.699508 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:31.699535 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.700619 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.700622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:31.701832 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:31.701845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:31.702782 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:31.702789 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:31.703062 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:31.703724 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:31.703750 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:31.706270 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:31.709185 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:31.709192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:31.709207 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:31.709721 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:31.710022 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:31.710027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:31.710031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:31.710249 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:31.710702 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:31.710710 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:31.711121 (+ 411us) client_negotiation.cc:769] Sending connection context
0810 03:16:31.711382 (+ 261us) client_negotiation.cc:240] Negotiation successful
0810 03:16:31.711855 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":325,"threads_started":1}
I20260810 03:16:31.714370 11117 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:31.714625 11117 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:31.715263 11117 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:31.716599 10635 ts_manager.cc:194] Registered new tserver with Master: 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
I20260810 03:16:31.717360 10635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:47171
W20260810 03:16:32.017961 11122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:32.018198 11122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:32.018321 11122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:32.025553 11122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:32.025650 11122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:32.025794 11122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:16:32.034808 11122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:34487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=33777
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:32.035889 11122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:32.037058 11122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:32.049028 11130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:32.048950 11131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:32.049068 11133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:32.050143 11122 server_base.cc:1034] running on GCE node
I20260810 03:16:32.050707 11122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:32.051584 11122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:32.052781 11122 hybrid_clock.cc:648] HybridClock initialized: now 1786331792052717 us; error 54 us; skew 500 ppm
I20260810 03:16:32.053063 11122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:32 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331792, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:32.056048 11122 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:16:32.057344 11122 webserver.cc:460] Webserver started at http://127.18.112.67:33777/ using document root <none> and password file <none>
I20260810 03:16:32.057929 11122 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:32.058068 11122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:32.063098 11122 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:16:32.065573 11143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:32.066730 11122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:16:32.066880 11122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "38c310a1acd54468992ec768db8663f1"
format_stamp: "Formatted at 2026-08-10 03:16:09 on dist-test-slave-jlzn"
server_key: "f4ca0824a9bb51af9f91005b0b457be1"
server_key_iv: "9f97d369201682a2671efeb66afed163"
server_key_version: "encryptionkey@0"
I20260810 03:16:32.067760 11122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:32.089119 11122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:32.093006 11122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:32.093262 11122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:32.094125 11122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:32.095350 11122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:32.095454 11122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:32.095569 11122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:32.095649 11122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:32.125344 11122 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:34487
I20260810 03:16:32.125416 11323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:34487 every 8 connection(s)
I20260810 03:16:32.126664 11122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:16:32.134927 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 11122
Aug 10 03:16:32 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331792, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:16:32.146349 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.129073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:36175 (local address 127.18.112.126:41347)
0810 03:16:32.129245 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.129250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.130350 (+ 1100us) server_negotiation.cc:407] Connection header received
0810 03:16:32.132150 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.132156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.132236 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.132320 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.133735 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.134436 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.136354 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.137005 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.137135 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.140674 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.140679 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.140682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.140713 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.143334 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.144073 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.144077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.144079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.144209 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.144626 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.144629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.144631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.144923 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.145080 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.145841 (+ 761us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.146054 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":60}
I20260810 03:16:32.147436 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.129527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:36175)
0810 03:16:32.130198 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.130235 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.131891 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.132562 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.132570 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.133050 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:32.133564 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.133581 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.134605 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.134609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.136171 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.136189 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.137213 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.137218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.137407 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.138033 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:32.138059 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:32.140480 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:32.143462 (+ 2982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:32.143470 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:32.143484 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:32.143947 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:32.144314 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:32.144320 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:32.144324 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:32.144501 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:32.145058 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:32.145063 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:32.145460 (+ 397us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.145743 (+ 283us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.146189 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":248,"threads_started":1}
I20260810 03:16:32.148912 11324 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41347
I20260810 03:16:32.149223 11324 heartbeater.cc:464] Registering TS with master...
I20260810 03:16:32.150030 11324 heartbeater.cc:511] Master 127.18.112.126:41347 requested a full tablet report, sending...
I20260810 03:16:32.150390 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.135745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.18.112.126:41347)
0810 03:16:32.136243 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.136249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.136582 (+ 333us) server_negotiation.cc:407] Connection header received
0810 03:16:32.136749 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.136752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.136812 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.136893 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.138652 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.139618 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.141298 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.141730 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.141838 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.144390 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.144394 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.144397 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.144425 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.147465 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.148292 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.148296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.148298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.148428 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.148840 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.148845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.148848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.149191 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.149481 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.149765 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.150000 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":390,"thread_start_us":263,"threads_started":1}
I20260810 03:16:32.151444 10635 ts_manager.cc:194] Registered new tserver with Master: 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487)
I20260810 03:16:32.152361 10635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:36175
I20260810 03:16:32.152808 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:16:32.158900 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.153676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40506 (local address 127.18.112.126:41347)
0810 03:16:32.153828 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.153832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.154281 (+ 449us) server_negotiation.cc:407] Connection header received
0810 03:16:32.154456 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.154461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.154571 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.154691 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:16:32.155150 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.155852 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.157245 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.157631 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.157740 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.158211 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:16:32.158379 (+ 168us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 03:16:32.158681 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40506: token expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 03:16:32.159001 11329 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40506: token expired
W20260810 03:16:32.159590 10520 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.112.126:41347)
I20260810 03:16:32.171010 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.160017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40514 (local address 127.18.112.126:41347)
0810 03:16:32.160170 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.160175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.160192 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:16:32.160320 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.160325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.160382 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.160451 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.161725 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.162416 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.163646 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.164095 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.164199 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.166527 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.166532 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.166537 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.166565 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.168632 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.169226 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.169231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.169235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.169355 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.169686 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.169691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.169695 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.169974 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.170195 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.170503 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.170711 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:16:32.174274 10635 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:16:32.181260 10635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:16:32.203042 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.192654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40936 (local address 127.18.112.66:35373)
0810 03:16:32.195137 (+ 2483us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.195146 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.195180 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:16:32.195286 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.195294 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.195523 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.195722 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:32.196621 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.198036 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.200603 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.201877 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.201997 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.202218 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.202546 (+ 328us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.202698 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2310,"thread_start_us":2161,"threads_started":1}
I20260810 03:16:32.203137 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.192143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35373 (local address 127.0.0.1:40936)
0810 03:16:32.194488 (+ 2345us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.194506 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.194616 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.196060 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.196068 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.196098 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:32.196466 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.196481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.198174 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.198180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.200400 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.200413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.202101 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.202107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.202296 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.202346 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.202472 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.202673 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2223,"mutex_wait_us":943,"thread_start_us":1190,"threads_started":1}
I20260810 03:16:32.203675 11340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.192132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:34487 (local address 127.0.0.1:34234)
0810 03:16:32.193240 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.193281 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.193440 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.196693 (+ 3253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.196697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.196723 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:32.197127 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.197139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.199103 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.199108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.201395 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.201407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.202961 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.202967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.203155 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.203188 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.203255 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.203366 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":671,"threads_started":1}
I20260810 03:16:32.204681 11341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.192274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.18.112.67:34487)
0810 03:16:32.196199 (+ 3925us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.196206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.196233 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:16:32.196311 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.196317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.196490 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.197342 (+ 852us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:32.197623 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.198971 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.201514 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.202730 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.203912 (+ 1182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.204123 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.204202 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.204357 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3761,"thread_start_us":3604,"threads_started":1}
I20260810 03:16:32.204738 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.193541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60494)
0810 03:16:32.195840 (+ 2299us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.195857 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.195972 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.197115 (+ 1143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.197119 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.197142 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:32.197498 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.197511 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.198946 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.198951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.201264 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.201279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.203942 (+ 2663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.203953 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.204138 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.204169 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.204254 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.204369 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2164,"mutex_wait_us":22,"thread_start_us":2034,"threads_started":1}
I20260810 03:16:32.205492 11347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.194049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60494 (local address 127.18.112.65:44845)
0810 03:16:32.195398 (+ 1349us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.195408 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.196098 (+ 690us) server_negotiation.cc:407] Connection header received
0810 03:16:32.196199 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.196206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.196680 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.196859 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:32.197684 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.198826 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.201424 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.203087 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.203491 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.203678 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.205028 (+ 1350us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.205187 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1195,"thread_start_us":1081,"threads_started":1}
I20260810 03:16:32.207074 11026 tablet_service.cc:1467] Processing CreateTablet for tablet bb6820275b574126a30c48380c9b0da0 (DEFAULT_TABLE table=test-table [id=3ed3a60eac034c789df11da45b0c7b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:32.208114 11218 tablet_service.cc:1467] Processing CreateTablet for tablet bb6820275b574126a30c48380c9b0da0 (DEFAULT_TABLE table=test-table [id=3ed3a60eac034c789df11da45b0c7b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:32.208650 11026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6820275b574126a30c48380c9b0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:32.209959 11218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6820275b574126a30c48380c9b0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:32.210536 10827 tablet_service.cc:1467] Processing CreateTablet for tablet bb6820275b574126a30c48380c9b0da0 (DEFAULT_TABLE table=test-table [id=3ed3a60eac034c789df11da45b0c7b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:16:32.211529 10827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb6820275b574126a30c48380c9b0da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:16:32.222683 11349 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Bootstrap starting.
I20260810 03:16:32.223953 11350 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Bootstrap starting.
I20260810 03:16:32.226244 11349 tablet_bootstrap.cc:654] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:32.226956 11350 tablet_bootstrap.cc:654] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:32.227494 11349 log.cc:824] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:32.227902 11352 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Bootstrap starting.
I20260810 03:16:32.228250 11350 log.cc:824] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:32.230983 11350 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: No bootstrap required, opened a new log
I20260810 03:16:32.231263 11350 ts_tablet_manager.cc:1397] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 03:16:32.231316 11349 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: No bootstrap required, opened a new log
I20260810 03:16:32.231380 11352 tablet_bootstrap.cc:654] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Neither blocks nor log segments found. Creating new log.
I20260810 03:16:32.231585 11349 ts_tablet_manager.cc:1397] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 03:16:32.232589 11352 log.cc:824] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:32.235420 11352 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: No bootstrap required, opened a new log
I20260810 03:16:32.235683 11352 ts_tablet_manager.cc:1397] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:16:32.238344 11350 raft_consensus.cc:348] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.238682 11350 raft_consensus.cc:374] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:32.238783 11350 raft_consensus.cc:729] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009027340d694d8b909331e50b3cecde, State: Initialized, Role: FOLLOWER
I20260810 03:16:32.239351 11350 consensus_queue.cc:260] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.240334 11117 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:32.241183 11349 raft_consensus.cc:348] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.241566 11349 raft_consensus.cc:374] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:32.241667 11349 raft_consensus.cc:729] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509a5bbdd0ad4aec8508ab2c18547a25, State: Initialized, Role: FOLLOWER
I20260810 03:16:32.242169 11350 ts_tablet_manager.cc:1428] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260810 03:16:32.242238 11349 consensus_queue.cc:260] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.243276 10918 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:32.243918 11349 ts_tablet_manager.cc:1428] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent starting tablet: real 0.012s user 0.009s sys 0.005s
I20260810 03:16:32.246497 11352 raft_consensus.cc:348] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.246819 11352 raft_consensus.cc:374] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:16:32.246912 11352 raft_consensus.cc:729] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c310a1acd54468992ec768db8663f1, State: Initialized, Role: FOLLOWER
I20260810 03:16:32.247433 11352 consensus_queue.cc:260] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.248463 11324 heartbeater.cc:503] Master 127.18.112.126:41347 was elected leader, sending a full tablet report...
I20260810 03:16:32.248958 11352 ts_tablet_manager.cc:1428] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Time spent starting tablet: real 0.013s user 0.007s sys 0.007s
W20260810 03:16:32.259016 10919 tablet.cc:2369] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:16:32.374714 11357 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:16:32.374998 11357 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.376714 11357 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
W20260810 03:16:32.378238 11325 tablet.cc:2369] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:16:32.383240 11341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.377099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:44579 (local address 127.18.112.67:34487)
0810 03:16:32.377308 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.377314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.377978 (+ 664us) server_negotiation.cc:407] Connection header received
0810 03:16:32.378292 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.378297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.378382 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.378449 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:32.379159 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.379900 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.381611 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.382386 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.382527 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.382601 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.382876 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.383003 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:16:32.383343 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.377114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:34487 (local address 127.18.112.65:44579)
0810 03:16:32.377871 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.377893 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.378098 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.378657 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.378660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.378680 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:32.379013 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.379021 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.380022 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.380026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.381467 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.381479 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.382582 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.382588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.382725 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.382752 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.382834 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.382986 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":395,"threads_started":1}
I20260810 03:16:32.383394 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.377134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39509 (local address 127.18.112.66:35373)
0810 03:16:32.377334 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.377340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.378161 (+ 821us) server_negotiation.cc:407] Connection header received
0810 03:16:32.378438 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.378443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.378517 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.378594 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:16:32.379402 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.380124 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.381793 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.382546 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.382688 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.382760 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.383032 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.383160 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:16:32.383431 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.377150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35373 (local address 127.18.112.65:39509)
0810 03:16:32.378060 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.378079 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:32.378270 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:32.378812 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:32.378817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:32.378846 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:16:32.379236 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.379246 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.380251 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.380255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.381645 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:32.381658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.382759 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.382766 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:32.382887 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.382910 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:16:32.382990 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:16:32.383102 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":579,"threads_started":1}
I20260810 03:16:32.384351 11051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6820275b574126a30c48380c9b0da0" candidate_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009027340d694d8b909331e50b3cecde" is_pre_election: true
I20260810 03:16:32.384356 11247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6820275b574126a30c48380c9b0da0" candidate_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c310a1acd54468992ec768db8663f1" is_pre_election: true
I20260810 03:16:32.384789 11051 raft_consensus.cc:2454] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509a5bbdd0ad4aec8508ab2c18547a25 in term 0.
I20260810 03:16:32.384784 11247 raft_consensus.cc:2454] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509a5bbdd0ad4aec8508ab2c18547a25 in term 0.
I20260810 03:16:32.385358 10755 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009027340d694d8b909331e50b3cecde, 509a5bbdd0ad4aec8508ab2c18547a25; no voters:
I20260810 03:16:32.385703 11357 raft_consensus.cc:2781] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:16:32.385833 11357 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:16:32.385928 11357 raft_consensus.cc:3037] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:32.388099 11357 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.388712 11357 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 1 election: Requested vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
I20260810 03:16:32.389088 11247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6820275b574126a30c48380c9b0da0" candidate_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38c310a1acd54468992ec768db8663f1"
I20260810 03:16:32.389143 11051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb6820275b574126a30c48380c9b0da0" candidate_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009027340d694d8b909331e50b3cecde"
I20260810 03:16:32.389258 11247 raft_consensus.cc:3037] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:32.389299 11051 raft_consensus.cc:3037] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:16:32.391393 11247 raft_consensus.cc:2454] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509a5bbdd0ad4aec8508ab2c18547a25 in term 1.
I20260810 03:16:32.391521 11051 raft_consensus.cc:2454] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509a5bbdd0ad4aec8508ab2c18547a25 in term 1.
I20260810 03:16:32.391774 10759 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c310a1acd54468992ec768db8663f1, 509a5bbdd0ad4aec8508ab2c18547a25; no voters:
I20260810 03:16:32.392083 11357 raft_consensus.cc:2781] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:16:32.392484 11357 raft_consensus.cc:686] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 LEADER]: Becoming Leader. State: Replica: 509a5bbdd0ad4aec8508ab2c18547a25, State: Running, Role: LEADER
I20260810 03:16:32.392922 11357 consensus_queue.cc:237] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:32.396881 10634 catalog_manager.cc:5495] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } health_report { overall_health: HEALTHY } } }
I20260810 03:16:32.434734 11347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.430133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60504 (local address 127.18.112.65:44845)
0810 03:16:32.430333 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.430338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.430356 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:16:32.430535 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.430539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.430623 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.430752 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:16:32.431025 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.431719 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.432947 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.433329 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.433416 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.433819 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:16:32.434274 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:16:32.434382 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.434419 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.434478 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 03:16:32.442166 11051 raft_consensus.cc:1261] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Refusing update from remote peer 509a5bbdd0ad4aec8508ab2c18547a25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:16:32.442219 11247 raft_consensus.cc:1261] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Refusing update from remote peer 509a5bbdd0ad4aec8508ab2c18547a25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:16:32.443050 11357 consensus_queue.cc:1035] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:16:32.443321 11365 consensus_queue.cc:1035] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:16:32.444669 11119 tablet.cc:2369] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:16:32.454346 11371 mvcc.cc:205] Tried to move back new op lower bound from 7316815021834883072 to 7316815021644648448. Current Snapshot: MvccSnapshot[applied={T|T < 7316815021834883072}]
I20260810 03:16:32.454597 11370 mvcc.cc:205] Tried to move back new op lower bound from 7316815021834883072 to 7316815021644648448. Current Snapshot: MvccSnapshot[applied={T|T < 7316815021834883072}]
I20260810 03:16:32.469887 10635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:16:32.470114 10635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:16:32.473474 10635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Sending DeleteTablet for 3 replicas of tablet bb6820275b574126a30c48380c9b0da0
I20260810 03:16:32.474601 11218 tablet_service.cc:1514] Processing DeleteTablet for tablet bb6820275b574126a30c48380c9b0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:32 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:34234
I20260810 03:16:32.474792 11026 tablet_service.cc:1514] Processing DeleteTablet for tablet bb6820275b574126a30c48380c9b0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:32 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:40936
I20260810 03:16:32.474906 10827 tablet_service.cc:1514] Processing DeleteTablet for tablet bb6820275b574126a30c48380c9b0da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:16:32 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:60494
I20260810 03:16:32.475520 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 10688
I20260810 03:16:32.487157 11386 tablet_replica.cc:330] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: stopping tablet replica
I20260810 03:16:32.487401 11388 tablet_replica.cc:330] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: stopping tablet replica
I20260810 03:16:32.487562 11386 raft_consensus.cc:2229] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:16:32.487783 11388 raft_consensus.cc:2229] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:16:32.488068 11386 raft_consensus.cc:2258] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:32.488469 11388 raft_consensus.cc:2258] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:32.489097 11385 tablet_replica.cc:330] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: stopping tablet replica
I20260810 03:16:32.489441 11385 raft_consensus.cc:2229] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:16:32.489923 11385 raft_consensus.cc:2258] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:16:32.490371 11386 ts_tablet_manager.cc:1905] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:16:32.491987 11385 ts_tablet_manager.cc:1905] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:16:32.497184 11386 ts_tablet_manager.cc:1918] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:16:32.497331 11386 log.cc:1196] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/bb6820275b574126a30c48380c9b0da0
I20260810 03:16:32.497867 11386 ts_tablet_manager.cc:1939] T bb6820275b574126a30c48380c9b0da0 P 009027340d694d8b909331e50b3cecde: Deleting consensus metadata
I20260810 03:16:32.497900 11347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.476330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60516 (local address 127.18.112.65:44845)
0810 03:16:32.476501 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.476507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.476791 (+ 284us) server_negotiation.cc:407] Connection header received
0810 03:16:32.476855 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.476861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.476936 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.477018 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.479112 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.480481 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.482578 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.483273 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.483389 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.488713 (+ 5324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.488728 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.488744 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.488786 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.493426 (+ 4640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.494371 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.494380 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.494384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.494581 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.495027 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.495031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.495034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.495459 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.496872 (+ 1413us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.497020 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.497240 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:16:32.498410 11385 ts_tablet_manager.cc:1918] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:16:32.498560 11385 log.cc:1196] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/bb6820275b574126a30c48380c9b0da0
I20260810 03:16:32.498819 10913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:32.499084 11385 ts_tablet_manager.cc:1939] T bb6820275b574126a30c48380c9b0da0 P 38c310a1acd54468992ec768db8663f1: Deleting consensus metadata
I20260810 03:16:32.499539 10611 catalog_manager.cc:4841] TS 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): tablet bb6820275b574126a30c48380c9b0da0 (table test-table [id=3ed3a60eac034c789df11da45b0c7b9e]) successfully deleted
I20260810 03:16:32.500770 10616 catalog_manager.cc:4841] TS 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): tablet bb6820275b574126a30c48380c9b0da0 (table test-table [id=3ed3a60eac034c789df11da45b0c7b9e]) successfully deleted
I20260810 03:16:32.593532 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 10688
W20260810 03:16:32.618741 10616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.112.65:44845 (error 108)
I20260810 03:16:32.618853 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 10922
I20260810 03:16:32.620561 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.620115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60530)
0810 03:16:32.620273 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.620389 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260810 03:16:32.620870 10616 catalog_manager.cc:4584] TS 509a5bbdd0ad4aec8508ab2c18547a25 (127.18.112.65:44845): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bb6820275b574126a30c48380c9b0da0: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
I20260810 03:16:32.631937 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.619539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40946 (local address 127.18.112.66:35373)
0810 03:16:32.619732 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.619736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.619852 (+ 116us) server_negotiation.cc:407] Connection header received
0810 03:16:32.620094 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.620100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.620197 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.620311 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.621808 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.622535 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.623741 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.624272 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.624365 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.626717 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.626729 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.626744 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.626774 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.629556 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.630178 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.630184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.630186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.630302 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.630577 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.630580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.630582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.630904 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.631116 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.631295 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.631442 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:16:32.632601 11108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:32.674252 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.673844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60540)
0810 03:16:32.674018 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.674116 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 03:16:32.675153 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.674812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60552)
0810 03:16:32.674949 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.675028 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 03:16:32.717538 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 10922
I20260810 03:16:32.735424 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.734942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60562)
0810 03:16:32.735163 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.735265 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 03:16:32.736493 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.736105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60564)
0810 03:16:32.736262 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.736353 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:16:32.741470 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 11122
I20260810 03:16:32.753901 11341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.742136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34242 (local address 127.18.112.67:34487)
0810 03:16:32.742320 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:32.742325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:32.742343 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:16:32.742461 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:32.742465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:32.742539 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:32.742621 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:32.743912 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.744634 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.745812 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:32.746193 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:32.746278 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:32.748771 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:32.748786 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:32.748803 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:32.748835 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:32.751476 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.752130 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.752137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.752140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.752277 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:32.752626 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:32.752629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:32.752631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:32.753005 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:32.753241 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:32.753454 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 03:16:32.753606 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:16:32.754500 11318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:32.816990 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.816468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60572)
0810 03:16:32.816701 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.816804 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260810 03:16:32.818035 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:32.817587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44845 (local address 127.0.0.1:60576)
0810 03:16:32.817802 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:32.817887 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:44845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 03:16:32.855314 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 11122
I20260810 03:16:32.880064 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 10589
I20260810 03:16:32.881119 10680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:16:32.995855 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 10589
I20260810 03:16:53.024870 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--webserver_interface=127.18.112.126
--webserver_port=38127
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:41347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:53.348105 11401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:53.348381 11401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:53.348521 11401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:53.355393 11401 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:16:53.355486 11401 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:16:53.355556 11401 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:16:53.355623 11401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:16:53.355695 11401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:53.355787 11401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:53.355871 11401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:16:53.355937 11401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:16:53.365067 11401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:41347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=38127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:53.366093 11401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:53.367439 11401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:53.379038 11410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:53.379235 11412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:53.379068 11409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:53.379952 11401 server_base.cc:1034] running on GCE node
I20260810 03:16:53.380715 11401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:53.381940 11401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:53.383167 11401 hybrid_clock.cc:648] HybridClock initialized: now 1786331813383100 us; error 45 us; skew 500 ppm
I20260810 03:16:53.383463 11401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:53 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331813, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:53.386472 11401 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:16:53.387830 11401 webserver.cc:460] Webserver started at http://127.18.112.126:38127/ using document root <none> and password file <none>
I20260810 03:16:53.388444 11401 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:53.388541 11401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:53.393608 11401 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:16:53.396245 11423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:53.397398 11401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:16:53.397536 11401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "e8b1d4c33b2f46318c815083ad14a50f"
format_stamp: "Formatted at 2026-08-10 03:16:07 on dist-test-slave-jlzn"
server_key: "32653895f4fc4fcc7d471899f948402c"
server_key_iv: "907a2ba92b7d682114b07bc64cb8af9d"
server_key_version: "encryptionkey@0"
I20260810 03:16:53.398375 11401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:53.418004 11401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:53.421612 11401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:53.421828 11401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:53.438859 11401 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:41347
I20260810 03:16:53.438898 11500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:41347 every 8 connection(s)
I20260810 03:16:53.440210 11401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:16:53.446632 11501 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:16:53.449914 11501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap starting.
I20260810 03:16:53.450317 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 11401
I20260810 03:16:53.451333 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:44845
--local_ip_for_outbound_sockets=127.18.112.65
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=37785
--webserver_interface=127.18.112.65
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:16:53.472656 11501 log.cc:824] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:53.488266 11501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:16:53.488746 11501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Bootstrap complete.
I20260810 03:16:53.497507 11501 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:53.498353 11501 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Initialized, Role: FOLLOWER
I20260810 03:16:53.498911 11501 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:53.499142 11501 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:16:53.499248 11501 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:16:53.499403 11501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:16:53.503260 11501 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:53.503711 11501 leader_election.cc:302] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b1d4c33b2f46318c815083ad14a50f; no voters:
I20260810 03:16:53.504312 11501 leader_election.cc:288] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 03:16:53.504444 11507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 3 FOLLOWER]: Leader election won for term 3
I20260810 03:16:53.506292 11501 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:16:53.509632 11507 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [term 3 LEADER]: Becoming Leader. State: Replica: e8b1d4c33b2f46318c815083ad14a50f, State: Running, Role: LEADER
I20260810 03:16:53.510305 11507 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } }
I20260810 03:16:53.513139 11508 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:53.513486 11508 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:53.513988 11510 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b1d4c33b2f46318c815083ad14a50f. Latest consensus state: current_term: 3 leader_uuid: "e8b1d4c33b2f46318c815083ad14a50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b1d4c33b2f46318c815083ad14a50f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41347 } } }
I20260810 03:16:53.514267 11510 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f [sys.catalog]: This master's current role is: LEADER
I20260810 03:16:53.516215 11527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:16:53.527097 11527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:16:53.528661 11527 catalog_manager.cc:1259] Loaded cluster ID: 29ec40bda6e3464a82513a98a1bbdf18
I20260810 03:16:53.528810 11527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:16:53.533569 11527 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:16:53.535316 11527 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Loaded TSK: 0
I20260810 03:16:53.535501 11527 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e8b1d4c33b2f46318c815083ad14a50f: Loaded TSK: 1
F20260810 03:16:53.536659 11527 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9679f359ad google::LogMessage::Fail() at ??:0
@ 0x7f9679f3888a google::LogMessage::SendToLog() at ??:0
@ 0x7f9679f354de google::LogMessage::Flush() at ??:0
@ 0x7f9679f36a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f967dc997d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f967dc8873e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f968f9641c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f968f963783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f968f9ef2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f968f9ef0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f968fa395e9 std::function<>::operator()() at ??:0
@ 0x7f968f967cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f968f965c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f968f9ed610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f968f9ed439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f967cb81345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f967cb8491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f967cb84799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f967cb5feaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f967fe396db start_thread at ??:0
@ 0x7f9678dcf61f clone at ??:0
W20260810 03:16:53.822682 11503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:53.822932 11503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:53.823050 11503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:53.829991 11503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:53.830087 11503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:53.830225 11503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:16:53.839334 11503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:44845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=37785
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:53.840447 11503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:53.841635 11503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:53.853875 11573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:53.853946 11574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:53.853969 11578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:53.854847 11503 server_base.cc:1034] running on GCE node
I20260810 03:16:53.855373 11503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:53.856232 11503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:53.857411 11503 hybrid_clock.cc:648] HybridClock initialized: now 1786331813857367 us; error 39 us; skew 500 ppm
I20260810 03:16:53.857688 11503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:53 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331813, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:53.860695 11503 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:16:53.861971 11503 webserver.cc:460] Webserver started at http://127.18.112.65:37785/ using document root <none> and password file <none>
I20260810 03:16:53.862577 11503 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:53.862703 11503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:53.867601 11503 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:16:53.870189 11589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:53.871333 11503 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:16:53.871479 11503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "509a5bbdd0ad4aec8508ab2c18547a25"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "340095afdf18fcfc4083b6e27e43fd2d"
server_key_iv: "d311eec780e7db20a27ec74007d5421f"
server_key_version: "encryptionkey@0"
I20260810 03:16:53.872442 11503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:53.896719 11503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:53.900218 11503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:53.900444 11503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:53.901321 11503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:53.902980 11599 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260810 03:16:53.908188 11503 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 03:16:53.908301 11503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260810 03:16:53.908416 11503 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 03:16:53.911326 11503 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 03:16:53.911403 11503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260810 03:16:53.911747 11599 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Bootstrap starting.
I20260810 03:16:53.919400 11599 log.cc:824] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Log is configured to *not* fsync() on all Append() calls
I20260810 03:16:53.933810 11599 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:16:53.934633 11599 tablet_bootstrap.cc:492] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Bootstrap complete.
I20260810 03:16:53.935139 11599 ts_tablet_manager.cc:1397] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.007s
I20260810 03:16:53.944433 11599 raft_consensus.cc:348] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:53.945811 11599 raft_consensus.cc:729] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509a5bbdd0ad4aec8508ab2c18547a25, State: Initialized, Role: FOLLOWER
I20260810 03:16:53.946717 11599 consensus_queue.cc:260] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:53.948658 11599 ts_tablet_manager.cc:1428] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260810 03:16:53.949208 11503 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44845
I20260810 03:16:53.949229 11778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44845 every 8 connection(s)
I20260810 03:16:53.950340 11503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:16:53.952425 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 11503
I20260810 03:16:53.953198 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:35373
--local_ip_for_outbound_sockets=127.18.112.66
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=41841
--webserver_interface=127.18.112.66
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:16:53.954944 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:53.953146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:48951)
0810 03:16:53.953947 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:53.954180 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":334,"threads_started":1}
W20260810 03:16:53.955487 11780 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:41347 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:41347: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
I20260810 03:16:53.956275 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:53.955971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:47251)
0810 03:16:53.956107 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:53.956179 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 03:16:53.957059 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:53.956739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:58491)
0810 03:16:53.956881 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:53.956947 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:16:53.957267 11780 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:16:54.270519 11783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:54.270769 11783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:54.270857 11783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:54.277779 11783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:54.277872 11783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:54.277981 11783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:16:54.286924 11783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:35373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=41841
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:54.288012 11783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:54.289131 11783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:54.301010 11794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:54.301084 11789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:54.301043 11791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:54.302003 11783 server_base.cc:1034] running on GCE node
I20260810 03:16:54.302558 11783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:54.303377 11783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:54.304615 11783 hybrid_clock.cc:648] HybridClock initialized: now 1786331814304562 us; error 36 us; skew 500 ppm
I20260810 03:16:54.304919 11783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:54 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331814, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:54.307929 11783 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:16:54.309165 11783 webserver.cc:460] Webserver started at http://127.18.112.66:41841/ using document root <none> and password file <none>
I20260810 03:16:54.309749 11783 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:54.309850 11783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:54.314841 11783 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 03:16:54.317366 11805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.318539 11783 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 03:16:54.318673 11783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "009027340d694d8b909331e50b3cecde"
format_stamp: "Formatted at 2026-08-10 03:16:08 on dist-test-slave-jlzn"
server_key: "2a1441c7dbfe3ac5d1353fc617ea3af4"
server_key_iv: "e02af1de05642da1d1f652b93cbf7e24"
server_key_version: "encryptionkey@0"
I20260810 03:16:54.319541 11783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:54.335915 11783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:54.339380 11783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:54.339593 11783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:54.340500 11783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:54.341684 11783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:54.341769 11783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.341849 11783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:54.341903 11783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.371363 11783 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:35373
I20260810 03:16:54.371433 11999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:35373 every 8 connection(s)
I20260810 03:16:54.372689 11783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:16:54.377063 12003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.375266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:56593)
0810 03:16:54.375985 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.376262 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":261,"threads_started":1}
W20260810 03:16:54.377686 12000 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:41347 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:41347: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
I20260810 03:16:54.378423 12003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.378117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:39251)
0810 03:16:54.378254 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.378328 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 03:16:54.378768 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 11783
I20260810 03:16:54.379227 12003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.378936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:43185)
0810 03:16:54.379053 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.379125 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 03:16:54.379444 12000 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:16:54.379449 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:34487
--local_ip_for_outbound_sockets=127.18.112.67
--tserver_master_addrs=127.18.112.126:41347
--webserver_port=33777
--webserver_interface=127.18.112.67
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:42905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:16:54.699231 12004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:16:54.699471 12004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:16:54.699573 12004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:16:54.707034 12004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:16:54.707165 12004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:16:54.707340 12004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:16:54.718575 12004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:42905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:34487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=33777
--tserver_master_addrs=127.18.112.126:41347
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:16:54.719756 12004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:16:54.721020 12004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:16:54.733095 12011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:54.733095 12015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:16:54.733167 12013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:16:54.733873 12004 server_base.cc:1034] running on GCE node
I20260810 03:16:54.734434 12004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:16:54.735251 12004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:16:54.736445 12004 hybrid_clock.cc:648] HybridClock initialized: now 1786331814736408 us; error 31 us; skew 500 ppm
I20260810 03:16:54.736718 12004 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:16:54 dist-test-slave-jlzn krb5kdc[9741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331814, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:16:54.739535 12004 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:16:54.740792 12004 webserver.cc:460] Webserver started at http://127.18.112.67:33777/ using document root <none> and password file <none>
I20260810 03:16:54.741400 12004 fs_manager.cc:359] Metadata directory not provided
I20260810 03:16:54.741518 12004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:16:54.746516 12004 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 03:16:54.749058 12026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.750267 12004 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:16:54.750422 12004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "38c310a1acd54468992ec768db8663f1"
format_stamp: "Formatted at 2026-08-10 03:16:09 on dist-test-slave-jlzn"
server_key: "f4ca0824a9bb51af9f91005b0b457be1"
server_key_iv: "9f97d369201682a2671efeb66afed163"
server_key_version: "encryptionkey@0"
I20260810 03:16:54.751305 12004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:16:54.767644 12004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:16:54.771055 12004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:16:54.771284 12004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:16:54.772212 12004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:16:54.773401 12004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:16:54.773502 12004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.773607 12004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:16:54.773682 12004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:16:54.802389 12004 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:34487
I20260810 03:16:54.802474 12202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:34487 every 8 connection(s)
I20260810 03:16:54.803745 12004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:16:54.805205 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 12004
I20260810 03:16:54.808774 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.806904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:51741)
0810 03:16:54.807641 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.807899 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":282,"threads_started":1}
W20260810 03:16:54.809392 12203 heartbeater.cc:644] Failed to heartbeat to 127.18.112.126:41347 (0 consecutive failures): Network error: Failed to ping master at 127.18.112.126:41347: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
I20260810 03:16:54.810142 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.809834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:36035)
0810 03:16:54.809974 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.810040 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 03:16:54.810896 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.810591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:39121)
0810 03:16:54.810722 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.810791 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:16:54.811115 12203 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:16:54.958469 12208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:54.957720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:44473)
0810 03:16:54.958181 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:54.958272 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":213,"threads_started":1}
I20260810 03:16:55.124889 12210 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:16:55.125172 12210 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:55.126752 12210 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
Aug 10 03:16:55 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331813, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
Aug 10 03:16:55 dist-test-slave-jlzn krb5kdc[9741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331813, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:16:55.147408 12208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.127042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:34487 (local address 127.18.112.65:57677)
0810 03:16:55.127365 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:55.127415 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:55.128074 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:55.132081 (+ 4007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:55.132089 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:55.132852 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:55.133585 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:55.133609 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.135103 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.135107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:55.136506 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:55.136519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.137461 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.137468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:55.137735 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:55.138482 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:55.138499 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:55.141406 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:55.144661 (+ 3255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:55.144666 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:55.144670 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:55.145010 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:55.145417 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:55.145422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:55.145426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:55.145552 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:55.146218 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:55.146223 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:55.146393 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 03:16:55.146499 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 03:16:55.146987 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":159,"spinlock_wait_cycles":18816}
I20260810 03:16:55.147493 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.127390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:58943 (local address 127.18.112.66:35373)
0810 03:16:55.129574 (+ 2184us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:55.129589 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:55.129630 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:16:55.131233 (+ 1603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:55.131242 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:55.131613 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:55.131918 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:55.133769 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.134915 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.136648 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.137268 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.137432 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:55.141194 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:55.141205 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:55.141221 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:55.141271 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:55.144029 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:55.144718 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:55.144724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:55.144729 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:55.144893 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:55.145319 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:55.145323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:55.145325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:55.145792 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:55.145967 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:55.146709 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 03:16:55.147078 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1968,"thread_start_us":1839,"threads_started":1}
I20260810 03:16:55.147528 12211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.127088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35373 (local address 127.18.112.65:58943)
0810 03:16:55.129233 (+ 2145us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:55.129250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:16:55.129364 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:16:55.132077 (+ 2713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:16:55.132089 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:16:55.132853 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:16:55.133586 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:55.133611 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.135096 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.135100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:55.136516 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:16:55.136529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.137468 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.137474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:16:55.137733 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:55.138437 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:16:55.138459 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:16:55.140898 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:16:55.144157 (+ 3259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:55.144165 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:55.144179 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:55.144582 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:55.145006 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:16:55.145012 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:16:55.145016 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:16:55.145205 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:16:55.145929 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:16:55.145937 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:16:55.146209 (+ 272us) client_negotiation.cc:769] Sending connection context
0810 03:16:55.146455 (+ 246us) client_negotiation.cc:240] Negotiation successful
0810 03:16:55.147124 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2021,"mutex_wait_us":386,"spinlock_wait_cycles":23296,"thread_start_us":1849,"threads_started":1}
I20260810 03:16:55.148087 12212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.127340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:57677 (local address 127.18.112.67:34487)
0810 03:16:55.129883 (+ 2543us) server_negotiation.cc:206] Beginning negotiation
0810 03:16:55.129892 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:16:55.129927 (+ 35us) server_negotiation.cc:407] Connection header received
0810 03:16:55.131428 (+ 1501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:16:55.131437 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:16:55.131782 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:16:55.132085 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:16:55.133766 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.134949 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.136643 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:16:55.137241 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:16:55.137411 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:16:55.141632 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:16:55.141642 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:16:55.141657 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:16:55.141707 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:16:55.144531 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:55.145153 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:55.145158 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:55.145163 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:55.145309 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:16:55.145660 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:16:55.145663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:16:55.145665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:16:55.146091 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:16:55.146261 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 03:16:55.146775 (+ 514us) server_negotiation.cc:299] Negotiation successful
0810 03:16:55.147154 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2407,"thread_start_us":2226,"threads_started":1}
W20260810 03:16:55.150580 11595 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
W20260810 03:16:55.150826 11590 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
I20260810 03:16:55.150955 11590 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509a5bbdd0ad4aec8508ab2c18547a25; no voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1
I20260810 03:16:55.151315 12210 raft_consensus.cc:2726] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:16:55.380702 12215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.379914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:39019)
0810 03:16:55.380350 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:55.380484 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":212,"threads_started":1}
I20260810 03:16:55.812292 12217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.811571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:46555)
0810 03:16:55.811999 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:55.812097 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":196,"threads_started":1}
I20260810 03:16:55.959897 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:55.959244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:54427)
0810 03:16:55.959621 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:55.959707 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":187,"threads_started":1}
I20260810 03:16:56.382066 12221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:56.381438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:45599)
0810 03:16:56.381844 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:56.381923 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":214,"threads_started":1}
I20260810 03:16:56.813722 12226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:56.813063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:41819)
0810 03:16:56.813472 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:56.813547 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":206,"threads_started":1}
I20260810 03:16:56.961282 12229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:56.960623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:46531)
0810 03:16:56.961044 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:56.961119 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":199,"threads_started":1}
I20260810 03:16:57.198664 12230 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:16:57.198843 12230 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:16:57.199404 12230 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
W20260810 03:16:57.200294 11595 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
W20260810 03:16:57.200474 11590 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
I20260810 03:16:57.200609 11590 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509a5bbdd0ad4aec8508ab2c18547a25; no voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1
I20260810 03:16:57.200846 12230 raft_consensus.cc:2726] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:16:57.383399 12232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:57.382775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:55683)
0810 03:16:57.383174 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:57.383251 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":195,"threads_started":1}
I20260810 03:16:57.815201 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:57.814525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:43491)
0810 03:16:57.814957 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:57.815045 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":233,"threads_started":1}
I20260810 03:16:57.962615 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:57.962001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:44287)
0810 03:16:57.962389 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:57.962463 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":205,"threads_started":1}
I20260810 03:16:58.384864 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:58.384172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:48653)
0810 03:16:58.384612 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:58.384691 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":212,"threads_started":1}
I20260810 03:16:58.816738 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:58.815961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:59807)
0810 03:16:58.816416 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:58.816531 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":214,"threads_started":1}
I20260810 03:16:58.964144 12240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:58.963383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:45721)
0810 03:16:58.963880 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:58.963968 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":210,"threads_started":1}
I20260810 03:16:59.386250 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:59.385608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:51307)
0810 03:16:59.386012 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:59.386089 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":212,"threads_started":1}
I20260810 03:16:59.818150 12242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:59.817492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:41791)
0810 03:16:59.817912 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:59.817991 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":228,"threads_started":1}
I20260810 03:16:59.965502 12243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:16:59.964867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:58737)
0810 03:16:59.965270 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 03:16:59.965353 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":203,"threads_started":1}
I20260810 03:17:00.387669 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:00.386997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:53123)
0810 03:17:00.387423 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:00.387504 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":217,"threads_started":1}
I20260810 03:17:00.437769 12245 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:00.437956 12245 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:17:00.438547 12245 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
W20260810 03:17:00.439373 11595 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
W20260810 03:17:00.439555 11590 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
I20260810 03:17:00.439678 11590 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509a5bbdd0ad4aec8508ab2c18547a25; no voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1
I20260810 03:17:00.439939 12245 raft_consensus.cc:2726] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:17:00.819623 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:00.818896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:56347)
0810 03:17:00.819370 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:00.819450 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":254,"threads_started":1}
I20260810 03:17:00.967113 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:00.966263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:50495)
0810 03:17:00.966760 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:00.966861 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":249,"threads_started":1}
I20260810 03:17:01.389292 12252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:01.388462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:36773)
0810 03:17:01.388999 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:01.389098 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":239,"threads_started":1}
I20260810 03:17:01.821198 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:01.820430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:35491)
0810 03:17:01.820910 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:01.820986 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":227,"threads_started":1}
I20260810 03:17:01.968698 12254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:01.967958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:44821)
0810 03:17:01.968415 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:01.968493 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":225,"threads_started":1}
I20260810 03:17:02.390676 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:02.390033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:57497)
0810 03:17:02.390410 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:02.390487 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":193,"threads_started":1}
I20260810 03:17:02.822623 12256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:02.821945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:42913)
0810 03:17:02.822347 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:02.822456 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":210,"threads_started":1}
I20260810 03:17:02.970106 12259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:02.969445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:57465)
0810 03:17:02.969861 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:02.969936 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":205,"threads_started":1}
I20260810 03:17:03.392256 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:03.391447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:40021)
0810 03:17:03.391971 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:03.392071 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":238,"threads_started":1}
I20260810 03:17:03.824180 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:03.823397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:55831)
0810 03:17:03.823938 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:03.824024 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":261,"threads_started":1}
I20260810 03:17:03.952420 12266 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:03.952615 12266 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:17:03.953230 12266 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
W20260810 03:17:03.954038 11595 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
W20260810 03:17:03.954231 11590 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
I20260810 03:17:03.954360 11590 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509a5bbdd0ad4aec8508ab2c18547a25; no voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1
I20260810 03:17:03.954587 12266 raft_consensus.cc:2726] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:17:03.971546 12267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:03.970824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:38087)
0810 03:17:03.971270 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:03.971377 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":198,"threads_started":1}
I20260810 03:17:04.393735 12268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:04.393071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:55425)
0810 03:17:04.393475 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:04.393558 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":217,"threads_started":1}
I20260810 03:17:04.825552 12269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:04.824931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:35743)
0810 03:17:04.825315 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:04.825389 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":203,"threads_started":1}
I20260810 03:17:04.972890 12270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:04.972238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:59285)
0810 03:17:04.972629 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:04.972714 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":207,"threads_started":1}
I20260810 03:17:05.395207 12271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:05.394509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:41511)
0810 03:17:05.394948 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:05.395032 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":212,"threads_started":1}
I20260810 03:17:05.827059 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:05.826320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:37331)
0810 03:17:05.826796 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:05.826888 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":216,"threads_started":1}
I20260810 03:17:05.974260 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:05.973612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:39721)
0810 03:17:05.974026 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:05.974100 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":213,"threads_started":1}
I20260810 03:17:06.396639 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:06.395982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:43895)
0810 03:17:06.396389 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:06.396470 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":203,"threads_started":1}
I20260810 03:17:06.828655 12276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:06.827958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:42579)
0810 03:17:06.828402 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:06.828478 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":231,"threads_started":1}
I20260810 03:17:06.975699 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:06.975003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:50991)
0810 03:17:06.975455 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:06.975536 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":249,"threads_started":1}
I20260810 03:17:07.398051 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:07.397386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:52583)
0810 03:17:07.397805 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:07.397890 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":213,"threads_started":1}
I20260810 03:17:07.830243 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:07.829552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:56105)
0810 03:17:07.829996 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:07.830082 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":226,"threads_started":1}
I20260810 03:17:07.977110 12282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:07.976434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:33557)
0810 03:17:07.976857 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:07.976935 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":229,"threads_started":1}
I20260810 03:17:08.347009 12284 raft_consensus.cc:482] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:08.347215 12284 raft_consensus.cc:504] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c310a1acd54468992ec768db8663f1" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 34487 } } peers { permanent_uuid: "009027340d694d8b909331e50b3cecde" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35373 } } peers { permanent_uuid: "509a5bbdd0ad4aec8508ab2c18547a25" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44845 } }
I20260810 03:17:08.347970 12284 leader_election.cc:288] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487), 009027340d694d8b909331e50b3cecde (127.18.112.66:35373)
W20260810 03:17:08.348847 11590 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 009027340d694d8b909331e50b3cecde (127.18.112.66:35373): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
W20260810 03:17:08.349014 11595 leader_election.cc:341] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 38c310a1acd54468992ec768db8663f1 (127.18.112.67:34487): Not found: Tablet not found: bb6820275b574126a30c48380c9b0da0
I20260810 03:17:08.349159 11595 leader_election.cc:302] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509a5bbdd0ad4aec8508ab2c18547a25; no voters: 009027340d694d8b909331e50b3cecde, 38c310a1acd54468992ec768db8663f1
I20260810 03:17:08.349402 12284 raft_consensus.cc:2726] T bb6820275b574126a30c48380c9b0da0 P 509a5bbdd0ad4aec8508ab2c18547a25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:17:08.399411 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:08.398754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:47497)
0810 03:17:08.399144 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:08.399229 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":194,"threads_started":1}
I20260810 03:17:08.831657 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:08.830967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:33637)
0810 03:17:08.831382 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:08.831456 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":212,"threads_started":1}
I20260810 03:17:08.978722 12292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:08.978065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.65:46983)
0810 03:17:08.978466 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:08.978549 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":207,"threads_started":1}
I20260810 03:17:09.401080 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:09.400395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.66:56247)
0810 03:17:09.400806 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:09.400930 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":198,"threads_started":1}
I20260810 03:17:09.810065 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 11503
I20260810 03:17:09.828680 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:09.811080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50994 (local address 127.18.112.65:44845)
0810 03:17:09.811602 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:09.811613 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:09.811657 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:17:09.811735 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:09.811745 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:09.812068 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:09.812251 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:09.813758 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:09.814829 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:09.816112 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:09.816665 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:09.816833 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:09.823251 (+ 6418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:09.823263 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:09.823277 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:09.823315 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:09.825970 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:09.826607 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:09.826613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:09.826616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:09.826765 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:09.827120 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:09.827124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:09.827126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:09.827484 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:09.827772 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:09.828124 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 03:17:09.828390 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":216,"threads_started":1}
I20260810 03:17:09.829952 11772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:09.834308 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:09.832659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41347 (local address 127.18.112.67:42039)
0810 03:17:09.833977 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:09.834115 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.126:41347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1188,"thread_start_us":1053,"threads_started":1}
I20260810 03:17:09.916949 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 11503
I20260810 03:17:09.944479 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 11783
I20260810 03:17:09.957031 12299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:09.945155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43456 (local address 127.18.112.66:35373)
0810 03:17:09.945622 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:09.945626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:09.945652 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:17:09.945705 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:09.945709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:09.945771 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:09.945859 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:09.947114 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:09.947940 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:09.949109 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:09.949519 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:09.949606 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:09.952003 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:09.952008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:09.952011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:09.952043 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:09.954653 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:09.955295 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:09.955299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:09.955301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:09.955430 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:09.955765 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:09.955768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:09.955770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:09.956077 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:09.956301 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:09.956510 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 03:17:09.956683 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":241,"threads_started":1}
I20260810 03:17:09.957715 11994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:10.040488 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 11783
I20260810 03:17:10.063450 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 12004
I20260810 03:17:10.075999 12301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:10.064152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49828 (local address 127.18.112.67:34487)
0810 03:17:10.064699 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:10.064703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:10.064723 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:17:10.064779 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:10.064783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:10.064857 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:10.064953 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:10.066299 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:10.067097 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:10.068379 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:10.068823 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:10.068919 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:10.071222 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:10.071227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:10.071230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:10.071263 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:10.073803 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:10.074382 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:10.074386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:10.074388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:10.074542 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:10.074810 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:10.074813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:10.074815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:10.075043 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:10.075251 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:10.075472 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 03:17:10.075654 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":253,"threads_started":1}
I20260810 03:17:10.076689 12196 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:10.159685 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 12004
2026-08-10T03:17:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64202 ms)
[----------] 30 tests from SecurityITest (293281 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:10 dist-test-slave-jlzn krb5kdc[12308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:10 dist-test-slave-jlzn krb5kdc[12308](info): set up 2 sockets
Aug 10 03:17:10 dist-test-slave-jlzn krb5kdc[12308](info): commencing operation
krb5kdc: starting...
W20260810 03:17:11.377796 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:11 dist-test-slave-jlzn krb5kdc[12308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:17:11.629320 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:39745
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:39745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:11.953898 12328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:11.954151 12328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:11.954278 12328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:11.961272 12328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:11.961365 12328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:11.961437 12328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:11.961509 12328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:11.961576 12328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:11.970642 12328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:39745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:39745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:11.971755 12328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:11.972923 12328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:11.985111 12335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:11.985085 12336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:11.985235 12338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:11.985824 12328 server_base.cc:1034] running on GCE node
I20260810 03:17:11.986533 12328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:11.987788 12328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:11.989027 12328 hybrid_clock.cc:648] HybridClock initialized: now 1786331831988977 us; error 37 us; skew 500 ppm
I20260810 03:17:11.989329 12328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:11 dist-test-slave-jlzn krb5kdc[12308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:11.992251 12328 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:17:11.993670 12328 webserver.cc:460] Webserver started at http://127.18.112.126:36749/ using document root <none> and password file <none>
I20260810 03:17:11.994295 12328 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:11.994419 12328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:11.994709 12328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:11.997553 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "f0d5a714428340f6888d2acc710b6505"
format_stamp: "Formatted at 2026-08-10 03:17:11 on dist-test-slave-jlzn"
server_key: "2259d5db114e8761c82b4bf9fdcf374a"
server_key_iv: "047be630787639c904501adfeefce15f"
server_key_version: "encryptionkey@0"
I20260810 03:17:11.998252 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "f0d5a714428340f6888d2acc710b6505"
format_stamp: "Formatted at 2026-08-10 03:17:11 on dist-test-slave-jlzn"
server_key: "2259d5db114e8761c82b4bf9fdcf374a"
server_key_iv: "047be630787639c904501adfeefce15f"
server_key_version: "encryptionkey@0"
I20260810 03:17:12.003125 12328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 03:17:12.006548 12346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:12.007840 12328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:17:12.008019 12328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "f0d5a714428340f6888d2acc710b6505"
format_stamp: "Formatted at 2026-08-10 03:17:11 on dist-test-slave-jlzn"
server_key: "2259d5db114e8761c82b4bf9fdcf374a"
server_key_iv: "047be630787639c904501adfeefce15f"
server_key_version: "encryptionkey@0"
I20260810 03:17:12.008199 12328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:12.029907 12328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:12.033557 12328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:12.033802 12328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:12.050904 12328 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:39745
I20260810 03:17:12.050925 12422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:39745 every 8 connection(s)
I20260810 03:17:12.052141 12328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:12.055540 12423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:12.060042 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 12328
I20260810 03:17:12.060231 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:12.060899 18881 external_mini_cluster.cc:1428] Setting key 0873fff13b64ad4be20161d3d7e51d60
I20260810 03:17:12.065768 12423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: Bootstrap starting.
I20260810 03:17:12.068596 12423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:12.069532 12423 log.cc:824] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:12.072448 12423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: No bootstrap required, opened a new log
Aug 10 03:17:12 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:12.080891 12423 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } }
I20260810 03:17:12.081353 12423 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:12.081492 12423 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d5a714428340f6888d2acc710b6505, State: Initialized, Role: FOLLOWER
I20260810 03:17:12.082012 12423 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } }
I20260810 03:17:12.082258 12423 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:12.082386 12423 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:12.082551 12423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:12.082597 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:12.062793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40408 (local address 127.18.112.126:39745)
0810 03:17:12.063563 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:12.063575 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:12.063614 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:17:12.065323 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:12.065344 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:12.065686 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:12.066039 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:12.067518 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.068847 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.070320 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.071154 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.071330 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:12.075644 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:12.075655 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:12.075668 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:12.075709 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:12.078629 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:12.079409 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:12.079415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:12.079420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:12.079584 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:12.079987 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:12.079990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:12.079992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:12.080463 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:12.080670 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:12.081145 (+ 475us) server_negotiation.cc:299] Negotiation successful
0810 03:17:12.081519 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":349,"threads_started":1}
I20260810 03:17:12.085201 12423 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } }
I20260810 03:17:12.085670 12423 leader_election.cc:302] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0d5a714428340f6888d2acc710b6505; no voters:
I20260810 03:17:12.086213 12423 leader_election.cc:288] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:12.086324 12433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:12.088088 12433 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [term 1 LEADER]: Becoming Leader. State: Replica: f0d5a714428340f6888d2acc710b6505, State: Running, Role: LEADER
I20260810 03:17:12.088230 12423 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:12.088621 12433 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } }
I20260810 03:17:12.091254 12435 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0d5a714428340f6888d2acc710b6505. Latest consensus state: current_term: 1 leader_uuid: "f0d5a714428340f6888d2acc710b6505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } } }
I20260810 03:17:12.091279 12434 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0d5a714428340f6888d2acc710b6505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d5a714428340f6888d2acc710b6505" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 39745 } } }
I20260810 03:17:12.091780 12435 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:12.091842 12434 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:12.093256 12443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:12.098120 12443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:12.106482 12443 catalog_manager.cc:1347] Generated new cluster ID: 1cc54c37c2344f98bebf0af645c1156e
I20260810 03:17:12.106628 12443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:12.123428 12443 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:12.124668 12443 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:12.129771 12443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: Generated new TSK 0
I20260810 03:17:12.130417 12443 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:17:12.207167 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:12.560568 12463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:12.560840 12463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:12.560964 12463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:12.567873 12463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:12.567986 12463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:12.568140 12463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:12.577226 12463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:12.578302 12463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:12.579610 12463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:12.592056 12469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:12.592113 12473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:12.592146 12470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:12.593605 12463 server_base.cc:1034] running on GCE node
I20260810 03:17:12.594115 12463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:12.594898 12463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:12.596081 12463 hybrid_clock.cc:648] HybridClock initialized: now 1786331832596045 us; error 29 us; skew 500 ppm
I20260810 03:17:12.596338 12463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:12 dist-test-slave-jlzn krb5kdc[12308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331832, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:12.599185 12463 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:17:12.600438 12463 webserver.cc:460] Webserver started at http://127.18.112.65:37149/ using document root <none> and password file <none>
I20260810 03:17:12.601034 12463 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:12.601133 12463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:12.601377 12463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:12.604054 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "14d9dcc9e5674c5695b864bc506b17fe"
format_stamp: "Formatted at 2026-08-10 03:17:12 on dist-test-slave-jlzn"
server_key: "9dcde1f0db3754cbba23b95946e53e54"
server_key_iv: "3bd08a9b55e6f30b3bc7ffdc89474fe1"
server_key_version: "encryptionkey@0"
I20260810 03:17:12.604751 12463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "14d9dcc9e5674c5695b864bc506b17fe"
format_stamp: "Formatted at 2026-08-10 03:17:12 on dist-test-slave-jlzn"
server_key: "9dcde1f0db3754cbba23b95946e53e54"
server_key_iv: "3bd08a9b55e6f30b3bc7ffdc89474fe1"
server_key_version: "encryptionkey@0"
I20260810 03:17:12.609334 12463 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:12.612452 12484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:12.613631 12463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:12.613780 12463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "14d9dcc9e5674c5695b864bc506b17fe"
format_stamp: "Formatted at 2026-08-10 03:17:12 on dist-test-slave-jlzn"
server_key: "9dcde1f0db3754cbba23b95946e53e54"
server_key_iv: "3bd08a9b55e6f30b3bc7ffdc89474fe1"
server_key_version: "encryptionkey@0"
I20260810 03:17:12.613941 12463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:12.645337 12463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:12.648728 12463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:12.648967 12463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:12.649816 12463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:12.651022 12463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:12.651094 12463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:12.651216 12463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:12.651266 12463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:12.681061 12463 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:38601
I20260810 03:17:12.681105 12651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:38601 every 8 connection(s)
I20260810 03:17:12.682193 12463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:12.683432 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 12463
I20260810 03:17:12.683691 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:12.684468 18881 external_mini_cluster.cc:1428] Setting key b7e7cbdaf11d7ee1900993736ccf147e
Aug 10 03:17:12 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331832, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:12.701928 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:12.684819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:51423 (local address 127.18.112.126:39745)
0810 03:17:12.685319 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:12.685324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:12.686410 (+ 1086us) server_negotiation.cc:407] Connection header received
0810 03:17:12.688184 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:12.688190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:12.688279 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:12.688417 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:12.689874 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.690814 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.692385 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.692911 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.693036 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:12.696202 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:12.696208 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:12.696211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:12.696249 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:12.699046 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:12.699869 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:12.699875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:12.699879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:12.700002 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:12.700426 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:12.700429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:12.700431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:12.700690 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:12.700798 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:12.701512 (+ 714us) server_negotiation.cc:299] Negotiation successful
0810 03:17:12.701683 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":243,"threads_started":1}
I20260810 03:17:12.703125 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:12.685358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:39745 (local address 127.18.112.65:51423)
0810 03:17:12.686158 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:12.686214 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:12.687931 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:12.688614 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:12.688622 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:12.689146 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:12.689719 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:12.689737 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.690954 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.690958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:12.692245 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:12.692258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:12.693101 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:12.693106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:12.693285 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:12.693870 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:12.693890 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:12.695974 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:12.699175 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:12.699184 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:12.699197 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:12.699736 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:12.700101 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:12.700106 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:12.700109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:12.700335 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:12.700806 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:12.700814 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:12.701173 (+ 359us) client_negotiation.cc:769] Sending connection context
0810 03:17:12.701433 (+ 260us) client_negotiation.cc:240] Negotiation successful
0810 03:17:12.701882 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":300,"threads_started":1}
I20260810 03:17:12.704522 12652 heartbeater.cc:347] Connected to a master server at 127.18.112.126:39745
I20260810 03:17:12.704807 12652 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:12.705461 12652 heartbeater.cc:511] Master 127.18.112.126:39745 requested a full tablet report, sending...
I20260810 03:17:12.707379 12369 ts_manager.cc:194] Registered new tserver with Master: 14d9dcc9e5674c5695b864bc506b17fe (127.18.112.65:38601)
I20260810 03:17:12.708778 12369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:51423
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:17:12.743950 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:13.070366 12665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:13.070629 12665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:13.070765 12665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:13.077731 12665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:13.077837 12665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:13.077982 12665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:13.087126 12665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:13.088383 12665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:13.089583 12665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:13.101784 12674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:13.101706 12673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:13.101747 12676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:13.102442 12665 server_base.cc:1034] running on GCE node
I20260810 03:17:13.103020 12665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:13.103915 12665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:13.105108 12665 hybrid_clock.cc:648] HybridClock initialized: now 1786331833105059 us; error 41 us; skew 500 ppm
I20260810 03:17:13.105389 12665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:13 dist-test-slave-jlzn krb5kdc[12308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331833, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:13.108354 12665 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:17:13.109649 12665 webserver.cc:460] Webserver started at http://127.18.112.66:37559/ using document root <none> and password file <none>
I20260810 03:17:13.110255 12665 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:13.110368 12665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:13.110651 12665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:13.113485 12665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "774a2fda2cf24dada32299d6db491bcb"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "b2df17cefaca7a0ba7f6c14caa65583d"
server_key_iv: "914e5dc4a7b382558e328f9aae416af3"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.114202 12665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "774a2fda2cf24dada32299d6db491bcb"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "b2df17cefaca7a0ba7f6c14caa65583d"
server_key_iv: "914e5dc4a7b382558e328f9aae416af3"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.118992 12665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260810 03:17:13.122148 12687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.123363 12665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:17:13.123514 12665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "774a2fda2cf24dada32299d6db491bcb"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "b2df17cefaca7a0ba7f6c14caa65583d"
server_key_iv: "914e5dc4a7b382558e328f9aae416af3"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.123682 12665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:13.153427 12665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:13.157441 12665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:13.157707 12665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:13.158589 12665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:13.159842 12665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:13.159919 12665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.160037 12665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:13.160100 12665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.190869 12665 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:35733
I20260810 03:17:13.190915 12870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:35733 every 8 connection(s)
I20260810 03:17:13.192122 12665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:13.194514 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 12665
I20260810 03:17:13.194712 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:13.195178 18881 external_mini_cluster.cc:1428] Setting key 98f53de4d0e050218ddceb66804f7217
Aug 10 03:17:13 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331833, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:13.211288 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.194462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:43941 (local address 127.18.112.126:39745)
0810 03:17:13.194688 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.194696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.195936 (+ 1240us) server_negotiation.cc:407] Connection header received
0810 03:17:13.197836 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.197842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.197939 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.198039 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:13.199407 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.200367 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.201833 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.202387 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.202506 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.205792 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:13.205797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:13.205800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:13.205833 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:13.208357 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.209037 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.209042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.209044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.209180 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.209673 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.209677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.209679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.209959 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:13.210093 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.210845 (+ 752us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.211036 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:17:13.212572 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.194948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:39745 (local address 127.18.112.66:43941)
0810 03:17:13.195742 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.195795 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.197577 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.198214 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.198222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.198708 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:13.199245 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.199262 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.200494 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.200497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.201701 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.201712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.202561 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.202566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.202762 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.203355 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:13.203377 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:13.205583 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:13.208496 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:13.208504 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:13.208519 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:13.208921 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:13.209292 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:13.209297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:13.209301 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:13.209553 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:13.210081 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:13.210089 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:13.210486 (+ 397us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.210789 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.211259 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":316,"threads_started":1}
I20260810 03:17:13.214043 12871 heartbeater.cc:347] Connected to a master server at 127.18.112.126:39745
I20260810 03:17:13.214331 12871 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:13.215023 12871 heartbeater.cc:511] Master 127.18.112.126:39745 requested a full tablet report, sending...
I20260810 03:17:13.216435 12369 ts_manager.cc:194] Registered new tserver with Master: 774a2fda2cf24dada32299d6db491bcb (127.18.112.66:35733)
I20260810 03:17:13.217272 12369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:43941
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:17:13.256223 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:13.573633 12877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:13.573891 12877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:13.574019 12877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:13.580858 12877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:13.580966 12877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:13.581112 12877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:13.590473 12877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:39745
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:13.591548 12877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:13.592783 12877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:13.604846 12886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:13.604928 12884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:13.604892 12889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:13.605665 12877 server_base.cc:1034] running on GCE node
I20260810 03:17:13.606213 12877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:13.606994 12877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:13.608176 12877 hybrid_clock.cc:648] HybridClock initialized: now 1786331833608139 us; error 25 us; skew 500 ppm
I20260810 03:17:13.608429 12877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:13 dist-test-slave-jlzn krb5kdc[12308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331833, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:13.611224 12877 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:17:13.612512 12877 webserver.cc:460] Webserver started at http://127.18.112.67:45201/ using document root <none> and password file <none>
I20260810 03:17:13.613114 12877 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:13.613220 12877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:13.613469 12877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:13.616094 12877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "504c4de87c724280b2b525a2a03e4eef"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "70947333636e76790a2c66177007d08b"
server_key_iv: "18f24474fc09c25b9970a34b2e638e49"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.616773 12877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "504c4de87c724280b2b525a2a03e4eef"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "70947333636e76790a2c66177007d08b"
server_key_iv: "18f24474fc09c25b9970a34b2e638e49"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.621446 12877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:13.624579 12899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.625727 12877 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:13.625872 12877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "504c4de87c724280b2b525a2a03e4eef"
format_stamp: "Formatted at 2026-08-10 03:17:13 on dist-test-slave-jlzn"
server_key: "70947333636e76790a2c66177007d08b"
server_key_iv: "18f24474fc09c25b9970a34b2e638e49"
server_key_version: "encryptionkey@0"
I20260810 03:17:13.626036 12877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:13.661985 12877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:13.665786 12877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:13.666029 12877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:13.666883 12877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:13.668120 12877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:13.668205 12877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.668323 12877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:13.668375 12877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:13.698868 12877 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:33363
I20260810 03:17:13.698916 13090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:33363 every 8 connection(s)
I20260810 03:17:13.700080 12877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:13.706763 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 12877
I20260810 03:17:13.706914 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:13.707356 18881 external_mini_cluster.cc:1428] Setting key 5abe591949445c5320064c3d5a2dfaa1
I20260810 03:17:13.711441 12652 heartbeater.cc:503] Master 127.18.112.126:39745 was elected leader, sending a full tablet report...
Aug 10 03:17:13 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331833, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:13.720000 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.702413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:50317 (local address 127.18.112.126:39745)
0810 03:17:13.702594 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.702599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.703671 (+ 1072us) server_negotiation.cc:407] Connection header received
0810 03:17:13.705417 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.705422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.705533 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.705624 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:13.706988 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.707831 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.709795 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.710376 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.710474 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.714293 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:13.714297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:13.714300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:13.714332 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:13.716797 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.717557 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.717563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.717566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.717789 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.718314 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.718320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.718322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.718601 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:13.718764 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.719407 (+ 643us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.719641 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:17:13.720888 13096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.702848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:39745 (local address 127.18.112.67:50317)
0810 03:17:13.703506 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.703554 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.705189 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.705808 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.705815 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.706288 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:13.706815 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.706838 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.707983 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.707987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.709660 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.709673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.710562 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.710567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.710759 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.711382 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:13.711410 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:13.714094 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:13.716926 (+ 2832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:13.716934 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:13.716948 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:13.717425 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:13.718013 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:13.718017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:13.718019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:13.718204 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:13.718734 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:13.718741 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:13.719045 (+ 304us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.719279 (+ 234us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.719726 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":269,"threads_started":1}
I20260810 03:17:13.722116 13091 heartbeater.cc:347] Connected to a master server at 127.18.112.126:39745
I20260810 03:17:13.722404 13091 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:13.723146 13091 heartbeater.cc:511] Master 127.18.112.126:39745 requested a full tablet report, sending...
I20260810 03:17:13.724522 12367 ts_manager.cc:194] Registered new tserver with Master: 504c4de87c724280b2b525a2a03e4eef (127.18.112.67:33363)
I20260810 03:17:13.725327 12367 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:50317
I20260810 03:17:13.734580 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:13.750735 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.738920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40424 (local address 127.18.112.126:39745)
0810 03:17:13.739111 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.739118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.739538 (+ 420us) server_negotiation.cc:407] Connection header received
0810 03:17:13.739674 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.739677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.739734 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.739828 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:13.741188 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.742248 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.743530 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.743954 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.744045 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.746195 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:13.746200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:13.746203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:13.746230 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:13.748593 (+ 2363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.749172 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.749175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.749177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.749297 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:13.749573 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:13.749576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:13.749578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:13.749872 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:13.750050 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.750293 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.750443 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:17:13.754254 12367 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:13.760902 12367 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:13.782910 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.771973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56640 (local address 127.18.112.66:35733)
0810 03:17:13.773156 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.773164 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.773846 (+ 682us) server_negotiation.cc:407] Connection header received
0810 03:17:13.774495 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.774505 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.774727 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.774880 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:13.775931 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.777583 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.780536 (+ 2953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.781511 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.781643 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.781833 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.782442 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.782595 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":940,"threads_started":1}
I20260810 03:17:13.782985 13115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.772521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49452 (local address 127.18.112.65:38601)
0810 03:17:13.774183 (+ 1662us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.774191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.774217 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:17:13.774313 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.774321 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.774558 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.774758 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:13.775786 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.777469 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.780338 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.781609 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.781742 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.781942 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.782506 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.782667 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1494,"thread_start_us":1340,"threads_started":1}
I20260810 03:17:13.783499 13109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.771948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:38601 (local address 127.0.0.1:49452)
0810 03:17:13.773667 (+ 1719us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.773903 (+ 236us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.774049 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.775040 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.775049 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.775090 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:13.775564 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.775577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.777642 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.777648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.780155 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.780170 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.782080 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.782086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.782270 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.782299 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.782387 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.783179 (+ 792us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1518,"mutex_wait_us":659,"thread_start_us":1737,"threads_started":1}
I20260810 03:17:13.782965 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.771886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35733 (local address 127.0.0.1:56640)
0810 03:17:13.773667 (+ 1781us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.773728 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.774275 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.775170 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.775174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.775202 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:13.775704 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.775718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.777790 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.777796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.780400 (+ 2604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.780417 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.781702 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.781709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.781899 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.781939 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.782341 (+ 402us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.782535 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1515,"mutex_wait_us":347,"thread_start_us":1451,"threads_started":1}
I20260810 03:17:13.787132 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.774090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:33363 (local address 127.0.0.1:60204)
0810 03:17:13.779658 (+ 5568us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.779671 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.779789 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.780241 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.780245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.780268 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:13.780673 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.780685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.782491 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.782496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.784757 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.784771 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.786447 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.786454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.786612 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.786643 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.786731 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.786844 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5463,"thread_start_us":5340,"threads_started":1}
I20260810 03:17:13.787299 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.774456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60204 (local address 127.18.112.67:33363)
0810 03:17:13.779251 (+ 4795us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.779258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.779762 (+ 504us) server_negotiation.cc:407] Connection header received
0810 03:17:13.779931 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.779936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.780081 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.780233 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:13.780846 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.782345 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.784938 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.786249 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.786389 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.786587 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.786805 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.786959 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4612,"thread_start_us":4464,"threads_started":1}
I20260810 03:17:13.787009 12754 tablet_service.cc:1467] Processing CreateTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 (DEFAULT_TABLE table=test-table [id=df987195c9c24e4187fba69bbab053f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:13.787374 12552 tablet_service.cc:1467] Processing CreateTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 (DEFAULT_TABLE table=test-table [id=df987195c9c24e4187fba69bbab053f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:13.788581 12754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d1a690de424b8cbd2eaf81a63cb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:13.789088 12552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d1a690de424b8cbd2eaf81a63cb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:13.791101 12991 tablet_service.cc:1467] Processing CreateTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 (DEFAULT_TABLE table=test-table [id=df987195c9c24e4187fba69bbab053f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:13.792440 12991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d1a690de424b8cbd2eaf81a63cb088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:13.800446 13121 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Bootstrap starting.
I20260810 03:17:13.802640 13122 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Bootstrap starting.
I20260810 03:17:13.804343 13121 tablet_bootstrap.cc:654] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:13.805596 13121 log.cc:824] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:13.805795 13123 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Bootstrap starting.
I20260810 03:17:13.806026 13122 tablet_bootstrap.cc:654] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:13.807112 13122 log.cc:824] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:13.808743 13121 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: No bootstrap required, opened a new log
I20260810 03:17:13.808919 13123 tablet_bootstrap.cc:654] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:13.809007 13121 ts_tablet_manager.cc:1397] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260810 03:17:13.809921 13123 log.cc:824] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:13.810032 13122 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: No bootstrap required, opened a new log
I20260810 03:17:13.810338 13122 ts_tablet_manager.cc:1397] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:17:13.813314 13123 tablet_bootstrap.cc:492] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: No bootstrap required, opened a new log
I20260810 03:17:13.813525 13123 ts_tablet_manager.cc:1397] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 03:17:13.818991 13121 raft_consensus.cc:348] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.819392 13121 raft_consensus.cc:374] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:13.819489 13121 raft_consensus.cc:729] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14d9dcc9e5674c5695b864bc506b17fe, State: Initialized, Role: FOLLOWER
I20260810 03:17:13.820088 13121 consensus_queue.cc:260] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.820204 13122 raft_consensus.cc:348] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.820367 13123 raft_consensus.cc:348] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.820626 13122 raft_consensus.cc:374] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:13.820734 13122 raft_consensus.cc:729] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 774a2fda2cf24dada32299d6db491bcb, State: Initialized, Role: FOLLOWER
I20260810 03:17:13.820863 13123 raft_consensus.cc:374] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:13.820966 13123 raft_consensus.cc:729] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504c4de87c724280b2b525a2a03e4eef, State: Initialized, Role: FOLLOWER
I20260810 03:17:13.821364 13122 consensus_queue.cc:260] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.821499 13123 consensus_queue.cc:260] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.822453 12871 heartbeater.cc:503] Master 127.18.112.126:39745 was elected leader, sending a full tablet report...
I20260810 03:17:13.823087 13122 ts_tablet_manager.cc:1428] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260810 03:17:13.824586 13121 ts_tablet_manager.cc:1428] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260810 03:17:13.825506 13091 heartbeater.cc:503] Master 127.18.112.126:39745 was elected leader, sending a full tablet report...
I20260810 03:17:13.826887 13123 ts_tablet_manager.cc:1428] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260810 03:17:13.906208 13130 raft_consensus.cc:482] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:13.906468 13130 raft_consensus.cc:504] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.908066 13130 leader_election.cc:288] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 774a2fda2cf24dada32299d6db491bcb (127.18.112.66:35733), 504c4de87c724280b2b525a2a03e4eef (127.18.112.67:33363)
I20260810 03:17:13.914611 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.908355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:51743 (local address 127.18.112.66:35733)
0810 03:17:13.908548 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.908554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.909295 (+ 741us) server_negotiation.cc:407] Connection header received
0810 03:17:13.909457 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.909461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.909517 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.909592 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:13.910235 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.910972 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.912923 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.913693 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.913811 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.913881 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.914234 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.914362 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:17:13.914623 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.908635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:54687 (local address 127.18.112.67:33363)
0810 03:17:13.908797 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.908803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.909272 (+ 469us) server_negotiation.cc:407] Connection header received
0810 03:17:13.909438 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.909442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.909498 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.909560 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:13.910124 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.910911 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.912978 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.913724 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.913875 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.913945 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.914280 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.914394 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 03:17:13.914749 13136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.908400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:35733 (local address 127.18.112.65:51743)
0810 03:17:13.909190 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.909204 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.909330 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.909619 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.909623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.909646 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:13.910078 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.910089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.911100 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.911103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.912777 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.912794 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.913903 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.913910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.914055 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.914108 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.914185 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.914311 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":54,"thread_start_us":454,"threads_started":1}
I20260810 03:17:13.914848 13135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.908328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:33363 (local address 127.18.112.65:54687)
0810 03:17:13.909166 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:13.909184 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:13.909308 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:13.909602 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:13.909607 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:13.909629 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:13.909990 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.909999 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.911039 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.911044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.912812 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:13.912826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.913955 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.913962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:13.914123 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.914152 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:17:13.914236 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 03:17:13.914375 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":89,"thread_start_us":484,"threads_started":1}
I20260810 03:17:13.915683 12786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d1a690de424b8cbd2eaf81a63cb088" candidate_uuid: "14d9dcc9e5674c5695b864bc506b17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "774a2fda2cf24dada32299d6db491bcb" is_pre_election: true
I20260810 03:17:13.915832 13017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d1a690de424b8cbd2eaf81a63cb088" candidate_uuid: "14d9dcc9e5674c5695b864bc506b17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504c4de87c724280b2b525a2a03e4eef" is_pre_election: true
I20260810 03:17:13.916265 12786 raft_consensus.cc:2454] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14d9dcc9e5674c5695b864bc506b17fe in term 0.
I20260810 03:17:13.916325 13017 raft_consensus.cc:2454] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14d9dcc9e5674c5695b864bc506b17fe in term 0.
I20260810 03:17:13.916931 12485 leader_election.cc:302] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14d9dcc9e5674c5695b864bc506b17fe, 774a2fda2cf24dada32299d6db491bcb; no voters:
I20260810 03:17:13.917294 13130 raft_consensus.cc:2781] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:13.917443 13130 raft_consensus.cc:482] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:13.917536 13130 raft_consensus.cc:3037] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:13.919687 13130 raft_consensus.cc:504] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.920311 13130 leader_election.cc:288] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [CANDIDATE]: Term 1 election: Requested vote from peers 774a2fda2cf24dada32299d6db491bcb (127.18.112.66:35733), 504c4de87c724280b2b525a2a03e4eef (127.18.112.67:33363)
I20260810 03:17:13.920634 12786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d1a690de424b8cbd2eaf81a63cb088" candidate_uuid: "14d9dcc9e5674c5695b864bc506b17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "774a2fda2cf24dada32299d6db491bcb"
I20260810 03:17:13.920850 12786 raft_consensus.cc:3037] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:13.921586 13017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d1a690de424b8cbd2eaf81a63cb088" candidate_uuid: "14d9dcc9e5674c5695b864bc506b17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504c4de87c724280b2b525a2a03e4eef"
I20260810 03:17:13.921757 13017 raft_consensus.cc:3037] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:13.923861 12786 raft_consensus.cc:2454] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14d9dcc9e5674c5695b864bc506b17fe in term 1.
I20260810 03:17:13.924211 12485 leader_election.cc:302] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14d9dcc9e5674c5695b864bc506b17fe, 774a2fda2cf24dada32299d6db491bcb; no voters:
I20260810 03:17:13.924490 13130 raft_consensus.cc:2781] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:13.924762 13017 raft_consensus.cc:2454] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14d9dcc9e5674c5695b864bc506b17fe in term 1.
I20260810 03:17:13.924932 13130 raft_consensus.cc:686] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 1 LEADER]: Becoming Leader. State: Replica: 14d9dcc9e5674c5695b864bc506b17fe, State: Running, Role: LEADER
I20260810 03:17:13.925402 13130 consensus_queue.cc:237] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } }
I20260810 03:17:13.929759 12367 catalog_manager.cc:5495] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 14d9dcc9e5674c5695b864bc506b17fe (127.18.112.65). New cstate: current_term: 1 leader_uuid: "14d9dcc9e5674c5695b864bc506b17fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14d9dcc9e5674c5695b864bc506b17fe" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 } health_report { overall_health: UNKNOWN } } }
W20260810 03:17:13.934219 12653 tablet.cc:2369] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:17:13.943890 12873 tablet.cc:2369] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:17:13.951540 13092 tablet.cc:2369] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:13.967588 13115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:13.963135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.18.112.65:38601)
0810 03:17:13.963298 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:13.963302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:13.963319 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:17:13.963450 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:13.963453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:13.963528 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:13.963647 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:13.963978 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.964665 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.965932 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:13.966296 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:13.966380 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:13.966759 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:13.967183 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:13.967283 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:13.967339 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 03:17:13.967398 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:17:13.974632 12786 raft_consensus.cc:1261] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 1 FOLLOWER]: Refusing update from remote peer 14d9dcc9e5674c5695b864bc506b17fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:13.974630 13017 raft_consensus.cc:1261] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 1 FOLLOWER]: Refusing update from remote peer 14d9dcc9e5674c5695b864bc506b17fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:13.975449 13137 consensus_queue.cc:1035] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "774a2fda2cf24dada32299d6db491bcb" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 35733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:13.975777 13130 consensus_queue.cc:1035] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "504c4de87c724280b2b525a2a03e4eef" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:13.986213 13145 mvcc.cc:205] Tried to move back new op lower bound from 7316815191951499264 to 7316815191761776640. Current Snapshot: MvccSnapshot[applied={T|T < 7316815191951499264}]
I20260810 03:17:13.999286 12366 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:13.999588 12366 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:14.003252 12366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0d5a714428340f6888d2acc710b6505: Sending DeleteTablet for 3 replicas of tablet c5d1a690de424b8cbd2eaf81a63cb088
I20260810 03:17:14.004309 12754 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:13 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:56640
I20260810 03:17:14.004483 12552 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:13 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:49452
I20260810 03:17:14.005182 12991 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d1a690de424b8cbd2eaf81a63cb088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:13 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:60204
I20260810 03:17:14.006575 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 12463
I20260810 03:17:14.017014 13155 tablet_replica.cc:330] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: stopping tablet replica
I20260810 03:17:14.018245 13155 raft_consensus.cc:2229] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:14.019047 13155 raft_consensus.cc:2258] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:14.021672 13155 ts_tablet_manager.cc:1905] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:14.022281 13157 tablet_replica.cc:330] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: stopping tablet replica
I20260810 03:17:14.022466 13156 tablet_replica.cc:330] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: stopping tablet replica
I20260810 03:17:14.022842 13156 raft_consensus.cc:2229] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:14.023329 13157 raft_consensus.cc:2229] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:14.023470 13156 raft_consensus.cc:2258] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:14.024354 13157 raft_consensus.cc:2258] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:14.026165 13157 ts_tablet_manager.cc:1905] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:14.026228 13156 ts_tablet_manager.cc:1905] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 03:17:14 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:17:14.033578 13156 ts_tablet_manager.cc:1918] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:14.033766 13156 log.cc:1196] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/c5d1a690de424b8cbd2eaf81a63cb088
I20260810 03:17:14.034288 13156 ts_tablet_manager.cc:1939] T c5d1a690de424b8cbd2eaf81a63cb088 P 14d9dcc9e5674c5695b864bc506b17fe: Deleting consensus metadata
I20260810 03:17:14.035239 13157 ts_tablet_manager.cc:1918] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:14.036028 12351 catalog_manager.cc:4841] TS 14d9dcc9e5674c5695b864bc506b17fe (127.18.112.65:38601): tablet c5d1a690de424b8cbd2eaf81a63cb088 (table test-table [id=df987195c9c24e4187fba69bbab053f7]) successfully deleted
I20260810 03:17:14.036298 13157 log.cc:1196] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/c5d1a690de424b8cbd2eaf81a63cb088
I20260810 03:17:14.036880 13157 ts_tablet_manager.cc:1939] T c5d1a690de424b8cbd2eaf81a63cb088 P 504c4de87c724280b2b525a2a03e4eef: Deleting consensus metadata
I20260810 03:17:14.038234 12351 catalog_manager.cc:4841] TS 504c4de87c724280b2b525a2a03e4eef (127.18.112.67:33363): tablet c5d1a690de424b8cbd2eaf81a63cb088 (table test-table [id=df987195c9c24e4187fba69bbab053f7]) successfully deleted
I20260810 03:17:14.040027 13155 ts_tablet_manager.cc:1918] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:14.040177 13155 log.cc:1196] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/c5d1a690de424b8cbd2eaf81a63cb088
I20260810 03:17:14.040200 13115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:14.008173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49476 (local address 127.18.112.65:38601)
0810 03:17:14.008337 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:14.008343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:14.020253 (+ 11910us) server_negotiation.cc:407] Connection header received
0810 03:17:14.020513 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:14.020519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:14.020654 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:14.020727 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:14.023938 (+ 3211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.025060 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.026868 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.027588 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.027691 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:14.033040 (+ 5349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:14.033055 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:14.033070 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:14.033116 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:14.037003 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.037851 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.037859 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.037862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.038039 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.038512 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.038517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.038520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.038956 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:14.039262 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:14.039583 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 03:17:14.039838 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:17:14.040692 13155 ts_tablet_manager.cc:1939] T c5d1a690de424b8cbd2eaf81a63cb088 P 774a2fda2cf24dada32299d6db491bcb: Deleting consensus metadata
I20260810 03:17:14.040895 12645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:14.042186 12347 catalog_manager.cc:4841] TS 774a2fda2cf24dada32299d6db491bcb (127.18.112.66:35733): tablet c5d1a690de424b8cbd2eaf81a63cb088 (table test-table [id=df987195c9c24e4187fba69bbab053f7]) successfully deleted
I20260810 03:17:14.136327 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 12463
I20260810 03:17:14.161852 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 12665
Aug 10 03:17:14 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:17:14.175282 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:14.162623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56648 (local address 127.18.112.66:35733)
0810 03:17:14.162785 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:14.162789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:14.162807 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:17:14.162912 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:14.162916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:14.162979 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:14.163061 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:14.164309 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.165048 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.166244 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.166604 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.166687 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:14.170510 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:14.170523 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:14.170537 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:14.170572 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:14.173161 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.173720 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.173725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.173728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.173847 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.174105 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.174108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.174110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.174468 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:14.174676 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:14.174878 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 03:17:14.175028 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:17:14.175966 12861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:14.260934 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 12665
I20260810 03:17:14.288090 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 12877
Aug 10 03:17:14 dist-test-slave-jlzn krb5kdc[12308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:17:14.301995 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:14.288843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60220 (local address 127.18.112.67:33363)
0810 03:17:14.289034 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:14.289039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:14.289057 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:17:14.289211 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:14.289215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:14.289289 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:14.289368 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:14.290624 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.291327 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.292690 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:14.293072 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:14.293168 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:14.297326 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:14.297340 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:14.297356 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:14.297387 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:14.299765 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.300358 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.300365 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.300368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.300507 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:14.300789 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:14.300791 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:14.300793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:14.301111 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:14.301326 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:14.301547 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 03:17:14.301704 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:17:14.302575 13084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:14.387446 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 12877
I20260810 03:17:14.405565 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 12328
I20260810 03:17:14.406602 12414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:14.513024 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 12328
2026-08-10T03:17:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4354 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T03:17:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:14Z Disabled control of system clock
I20260810 03:17:14.594811 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41677
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:41677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:14.917217 13167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:14.917465 13167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:14.917588 13167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:14.924499 13167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:14.924600 13167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:14.924660 13167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:14.924734 13167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:14.924796 13167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:14.933557 13167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:41677
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:14.934648 13167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:14.936272 13167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:14.946962 13180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:14.946992 13176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:14.947023 13178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:14.947738 13167 server_base.cc:1034] running on GCE node
I20260810 03:17:14.948449 13167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:14.949645 13167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:14.950838 13167 hybrid_clock.cc:648] HybridClock initialized: now 1786331834950800 us; error 26 us; skew 500 ppm
I20260810 03:17:14.951166 13167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:14.955551 13167 webserver.cc:460] Webserver started at http://127.18.112.126:46569/ using document root <none> and password file <none>
I20260810 03:17:14.956220 13167 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:14.956314 13167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:14.956610 13167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:14.959227 13167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "c901b05a70f24e22843ece49ace36972"
format_stamp: "Formatted at 2026-08-10 03:17:14 on dist-test-slave-jlzn"
server_key: "7cdbfad17c2f6a4be101f16254bedcc3"
server_key_iv: "6b7189403a9e8186bf6a9c9c52290b8f"
server_key_version: "encryptionkey@0"
I20260810 03:17:14.960016 13167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "c901b05a70f24e22843ece49ace36972"
format_stamp: "Formatted at 2026-08-10 03:17:14 on dist-test-slave-jlzn"
server_key: "7cdbfad17c2f6a4be101f16254bedcc3"
server_key_iv: "6b7189403a9e8186bf6a9c9c52290b8f"
server_key_version: "encryptionkey@0"
I20260810 03:17:14.964668 13167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:14.967741 13191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:14.968904 13167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:14.969071 13167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "c901b05a70f24e22843ece49ace36972"
format_stamp: "Formatted at 2026-08-10 03:17:14 on dist-test-slave-jlzn"
server_key: "7cdbfad17c2f6a4be101f16254bedcc3"
server_key_iv: "6b7189403a9e8186bf6a9c9c52290b8f"
server_key_version: "encryptionkey@0"
I20260810 03:17:14.969259 13167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:14.980329 13167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:14.980991 13167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:14.981236 13167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:14.998502 13167 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:41677
I20260810 03:17:14.998533 13273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:41677 every 8 connection(s)
I20260810 03:17:14.999629 13167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:15.002948 13274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:15.004124 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 13167
I20260810 03:17:15.004290 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:15.004734 18881 external_mini_cluster.cc:1428] Setting key 56f1d0fb56054061cb2bdb487e94f6e9
I20260810 03:17:15.015543 13274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: Bootstrap starting.
I20260810 03:17:15.017204 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:15.006397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.18.112.126:41677)
0810 03:17:15.007355 (+ 958us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:15.007368 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:15.007411 (+ 43us) server_negotiation.cc:407] Connection header received
0810 03:17:15.008944 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:15.008968 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:15.009387 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:15.009678 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:15.010268 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.011466 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.013316 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.013935 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.014068 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:15.015186 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:15.015193 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:15.015204 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:15.015677 (+ 473us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:15.015759 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:15.015779 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:15.015901 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:15.016107 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 03:17:15.016366 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":366,"threads_started":1}
I20260810 03:17:15.018524 13274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:15.019516 13274 log.cc:824] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:15.021960 13274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: No bootstrap required, opened a new log
I20260810 03:17:15.029273 13274 raft_consensus.cc:348] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } }
I20260810 03:17:15.029569 13274 raft_consensus.cc:374] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:15.029649 13274 raft_consensus.cc:729] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c901b05a70f24e22843ece49ace36972, State: Initialized, Role: FOLLOWER
I20260810 03:17:15.030092 13274 consensus_queue.cc:260] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } }
I20260810 03:17:15.030373 13274 raft_consensus.cc:388] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:15.030503 13274 raft_consensus.cc:482] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:15.030678 13274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:15.032694 13274 raft_consensus.cc:504] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } }
I20260810 03:17:15.033116 13274 leader_election.cc:302] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c901b05a70f24e22843ece49ace36972; no voters:
I20260810 03:17:15.033615 13274 leader_election.cc:288] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:15.033726 13282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:15.034349 13282 raft_consensus.cc:686] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [term 1 LEADER]: Becoming Leader. State: Replica: c901b05a70f24e22843ece49ace36972, State: Running, Role: LEADER
I20260810 03:17:15.034816 13282 consensus_queue.cc:237] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } }
I20260810 03:17:15.035387 13274 sys_catalog.cc:564] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:15.037334 13285 sys_catalog.cc:455] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c901b05a70f24e22843ece49ace36972. Latest consensus state: current_term: 1 leader_uuid: "c901b05a70f24e22843ece49ace36972" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } } }
I20260810 03:17:15.037240 13284 sys_catalog.cc:455] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c901b05a70f24e22843ece49ace36972" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c901b05a70f24e22843ece49ace36972" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41677 } } }
I20260810 03:17:15.037695 13285 sys_catalog.cc:458] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:15.037693 13284 sys_catalog.cc:458] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:15.040818 13293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:15.045608 13293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:15.053690 13293 catalog_manager.cc:1347] Generated new cluster ID: fc235499e2284eb29a698f5999d5b734
I20260810 03:17:15.053790 13293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:15.063323 13293 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:15.064436 13293 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:15.072751 13293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: Generated new TSK 0
I20260810 03:17:15.073479 13293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:15.079178 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--builtin_ntp_servers=127.18.112.84:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:15.424619 13309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:15.424853 13309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:15.424940 13309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:15.431825 13309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:15.431921 13309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:15.432034 13309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:15.440660 13309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:15.441768 13309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:15.443341 13309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:15.455246 13318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:15.455305 13316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:15.455324 13320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:15.456056 13309 server_base.cc:1034] running on GCE node
I20260810 03:17:15.456619 13309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:15.457464 13309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:15.458670 13309 hybrid_clock.cc:648] HybridClock initialized: now 1786331835458628 us; error 30 us; skew 500 ppm
I20260810 03:17:15.458951 13309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:15.461024 13309 webserver.cc:460] Webserver started at http://127.18.112.65:36577/ using document root <none> and password file <none>
I20260810 03:17:15.461633 13309 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:15.461735 13309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:15.462020 13309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:15.464672 13309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "8b11821cd4d64bfdaf04d5d2139c9674"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "8be6ea460442f0343298e8a5f8188342"
server_key_iv: "97d90fe6f328504df1cc5fd40bd54c42"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.465409 13309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "8b11821cd4d64bfdaf04d5d2139c9674"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "8be6ea460442f0343298e8a5f8188342"
server_key_iv: "97d90fe6f328504df1cc5fd40bd54c42"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.469995 13309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:17:15.473167 13329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.474329 13309 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:17:15.474463 13309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "8b11821cd4d64bfdaf04d5d2139c9674"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "8be6ea460442f0343298e8a5f8188342"
server_key_iv: "97d90fe6f328504df1cc5fd40bd54c42"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.474649 13309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:15.487247 13309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:15.487974 13309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:15.488240 13309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:15.489089 13309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:15.490433 13309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:15.490518 13309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.490622 13309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:15.490693 13309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.517961 13309 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:44855
I20260810 03:17:15.518065 13500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:44855 every 8 connection(s)
I20260810 03:17:15.519203 13309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:15.520397 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 13309
I20260810 03:17:15.520573 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:15.521122 18881 external_mini_cluster.cc:1428] Setting key a1ccc06c2e68da1e18b2c28fd232a968
I20260810 03:17:15.524096 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--builtin_ntp_servers=127.18.112.84:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:15.531530 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:15.521847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:53261 (local address 127.18.112.126:41677)
0810 03:17:15.522294 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:15.522299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:15.523561 (+ 1262us) server_negotiation.cc:407] Connection header received
0810 03:17:15.525340 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:15.525345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:15.525424 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:15.525520 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:15.526645 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.527380 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.528937 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.529355 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.529461 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:15.530725 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:15.530730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:15.530733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:15.530750 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:15.530795 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:15.530807 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:15.530881 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:15.531085 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 03:17:15.531183 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":251,"threads_started":1}
I20260810 03:17:15.532492 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:15.522430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41677 (local address 127.18.112.65:53261)
0810 03:17:15.523430 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:15.523465 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:15.525084 (+ 1619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:15.525774 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:15.525781 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:15.525861 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:15.526468 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:15.526492 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.527531 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.527535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:15.528798 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:15.528810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.529566 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.529573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:15.529803 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:15.530426 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:15.530429 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:15.530466 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:15.530536 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:15.530895 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:15.530907 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:15.530914 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:15.531057 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 03:17:15.531424 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":307,"threads_started":1}
I20260810 03:17:15.533831 13502 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41677
I20260810 03:17:15.534106 13502 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:15.534855 13502 heartbeater.cc:511] Master 127.18.112.126:41677 requested a full tablet report, sending...
I20260810 03:17:15.536983 13220 ts_manager.cc:194] Registered new tserver with Master: 8b11821cd4d64bfdaf04d5d2139c9674 (127.18.112.65:44855)
I20260810 03:17:15.538399 13220 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.65:53261
W20260810 03:17:15.840925 13506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:15.841187 13506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:15.841323 13506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:15.848212 13506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:15.848304 13506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:15.848443 13506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:15.857113 13506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:15.858304 13506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:15.860019 13506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:15.872295 13517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:15.872437 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:15.872408 13515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:15.873214 13506 server_base.cc:1034] running on GCE node
I20260810 03:17:15.873802 13506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:15.874639 13506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:15.875859 13506 hybrid_clock.cc:648] HybridClock initialized: now 1786331835875800 us; error 46 us; skew 500 ppm
I20260810 03:17:15.876152 13506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:15.878253 13506 webserver.cc:460] Webserver started at http://127.18.112.66:42445/ using document root <none> and password file <none>
I20260810 03:17:15.878872 13506 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:15.878971 13506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:15.879302 13506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:15.881996 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "c8ae98f54f7d4345a71429882236e101"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "15f40f6efb539c40c5808eaa00763786"
server_key_iv: "2c9280f2f18796343f15b91c796d953c"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.882745 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "c8ae98f54f7d4345a71429882236e101"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "15f40f6efb539c40c5808eaa00763786"
server_key_iv: "2c9280f2f18796343f15b91c796d953c"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.887758 13506 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 03:17:15.890978 13525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.892174 13506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:15.892355 13506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "c8ae98f54f7d4345a71429882236e101"
format_stamp: "Formatted at 2026-08-10 03:17:15 on dist-test-slave-jlzn"
server_key: "15f40f6efb539c40c5808eaa00763786"
server_key_iv: "2c9280f2f18796343f15b91c796d953c"
server_key_version: "encryptionkey@0"
I20260810 03:17:15.892568 13506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:15.905613 13506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:15.906279 13506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:15.906533 13506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:15.907363 13506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:15.909008 13506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:15.909103 13506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.909214 13506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:15.909288 13506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:15.938232 13506 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:38709
I20260810 03:17:15.938288 13690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:38709 every 8 connection(s)
I20260810 03:17:15.939365 13506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:15.941166 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 13506
I20260810 03:17:15.941339 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:15.941798 18881 external_mini_cluster.cc:1428] Setting key 3fde2544d179b66aefaaa4802a5c1dac
I20260810 03:17:15.944494 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--builtin_ntp_servers=127.18.112.84:43335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:15.951148 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:15.941802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:45207 (local address 127.18.112.126:41677)
0810 03:17:15.942006 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:15.942012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:15.943477 (+ 1465us) server_negotiation.cc:407] Connection header received
0810 03:17:15.945264 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:15.945270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:15.945348 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:15.945435 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:15.946428 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.947135 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.948675 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.949072 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.949183 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:15.950391 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:15.950397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:15.950401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:15.950418 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:15.950451 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:15.950462 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:15.950536 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:15.950738 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 03:17:15.950839 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:17:15.952092 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:15.942300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41677 (local address 127.18.112.66:45207)
0810 03:17:15.943333 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:15.943384 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:15.945009 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:15.945667 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:15.945674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:15.945763 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:15.946270 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:15.946287 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.947289 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.947293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:15.948533 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:15.948546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:15.949281 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:15.949289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:15.949494 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:15.950106 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:15.950108 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:15.950142 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:15.950212 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:15.950549 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:15.950560 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:15.950567 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:15.950723 (+ 156us) client_negotiation.cc:240] Negotiation successful
0810 03:17:15.951059 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":339,"threads_started":1}
I20260810 03:17:15.953413 13691 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41677
I20260810 03:17:15.953662 13691 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:15.954340 13691 heartbeater.cc:511] Master 127.18.112.126:41677 requested a full tablet report, sending...
I20260810 03:17:15.955677 13220 ts_manager.cc:194] Registered new tserver with Master: c8ae98f54f7d4345a71429882236e101 (127.18.112.66:38709)
I20260810 03:17:15.956496 13220 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.66:45207
W20260810 03:17:16.262259 13694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:16.262521 13694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:16.262650 13694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:16.269451 13694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:16.269549 13694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:16.269688 13694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:16.278314 13694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:43335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:41677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:16.279376 13694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:16.280995 13694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:16.293114 13700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:16.293179 13703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:16.293237 13706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:16.294435 13694 server_base.cc:1034] running on GCE node
I20260810 03:17:16.294935 13694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:16.295720 13694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:16.296912 13694 hybrid_clock.cc:648] HybridClock initialized: now 1786331836296856 us; error 41 us; skew 500 ppm
I20260810 03:17:16.297245 13694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:16.299263 13694 webserver.cc:460] Webserver started at http://127.18.112.67:33353/ using document root <none> and password file <none>
I20260810 03:17:16.299914 13694 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:16.300019 13694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:16.300313 13694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:16.302868 13694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "afaae1428ae544b286c61baed4748356"
format_stamp: "Formatted at 2026-08-10 03:17:16 on dist-test-slave-jlzn"
server_key: "03086e94f59e276911a6b0a193aa420a"
server_key_iv: "4c3c574b5a93ad19ecffdffe486ea874"
server_key_version: "encryptionkey@0"
I20260810 03:17:16.303586 13694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "afaae1428ae544b286c61baed4748356"
format_stamp: "Formatted at 2026-08-10 03:17:16 on dist-test-slave-jlzn"
server_key: "03086e94f59e276911a6b0a193aa420a"
server_key_iv: "4c3c574b5a93ad19ecffdffe486ea874"
server_key_version: "encryptionkey@0"
I20260810 03:17:16.308176 13694 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 03:17:16.311251 13717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:16.312423 13694 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:16.312577 13694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "afaae1428ae544b286c61baed4748356"
format_stamp: "Formatted at 2026-08-10 03:17:16 on dist-test-slave-jlzn"
server_key: "03086e94f59e276911a6b0a193aa420a"
server_key_iv: "4c3c574b5a93ad19ecffdffe486ea874"
server_key_version: "encryptionkey@0"
I20260810 03:17:16.312760 13694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:16.325690 13694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:16.326351 13694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:16.326610 13694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:16.327445 13694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:16.328817 13694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:16.328912 13694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:16.329010 13694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:16.329078 13694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:16.358101 13694 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:39003
I20260810 03:17:16.358173 13886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:39003 every 8 connection(s)
I20260810 03:17:16.359292 13694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:16.360929 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 13694
I20260810 03:17:16.361071 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:16.361482 18881 external_mini_cluster.cc:1428] Setting key 292244bedfb40d433b8c9a8bb9806820
I20260810 03:17:16.371032 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.361688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:59523 (local address 127.18.112.126:41677)
0810 03:17:16.361907 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.361913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.363237 (+ 1324us) server_negotiation.cc:407] Connection header received
0810 03:17:16.365188 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.365194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.365274 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.365361 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:16.366353 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.367085 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.368637 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.369034 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.369160 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.370283 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:16.370289 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:16.370292 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:16.370308 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:16.370340 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:16.370352 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:16.370423 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.370621 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.370717 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:17:16.371913 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.362179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:41677 (local address 127.18.112.67:59523)
0810 03:17:16.363096 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.363150 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.364943 (+ 1793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.365576 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.365584 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.365670 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:16.366189 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.366207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.367235 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.367239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.368503 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.368516 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.369241 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.369249 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.369452 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.370000 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:16.370002 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:16.370037 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:16.370109 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:16.370436 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:16.370447 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:16.370454 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.370595 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.370944 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":278,"threads_started":1}
I20260810 03:17:16.373041 13887 heartbeater.cc:347] Connected to a master server at 127.18.112.126:41677
I20260810 03:17:16.373303 13887 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:16.374009 13887 heartbeater.cc:511] Master 127.18.112.126:41677 requested a full tablet report, sending...
I20260810 03:17:16.375347 13220 ts_manager.cc:194] Registered new tserver with Master: afaae1428ae544b286c61baed4748356 (127.18.112.67:39003)
I20260810 03:17:16.376410 13220 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.67:59523
I20260810 03:17:16.376605 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:16.385532 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.380585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44100 (local address 127.18.112.126:41677)
0810 03:17:16.380723 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.380726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.381206 (+ 480us) server_negotiation.cc:407] Connection header received
0810 03:17:16.381312 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.381316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.381383 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.381457 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:16.381850 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.382468 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.383754 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.384167 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.384253 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.385061 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:16.385065 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:16.385068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:16.385084 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:16.385111 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:16.385122 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:16.385183 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.385263 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.385324 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:17:16.388589 13220 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:16.395234 13220 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:16.423724 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.406645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41694 (local address 127.18.112.67:39003)
0810 03:17:16.414077 (+ 7432us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.414085 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.414812 (+ 727us) server_negotiation.cc:407] Connection header received
0810 03:17:16.415060 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.415068 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.415297 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.415496 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.417071 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.418455 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.420828 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.422140 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.422278 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.422531 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.423200 (+ 669us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.423366 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7275,"thread_start_us":7142,"threads_started":1}
I20260810 03:17:16.423733 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.406062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46554 (local address 127.18.112.65:44855)
0810 03:17:16.412674 (+ 6612us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.412682 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.414743 (+ 2061us) server_negotiation.cc:407] Connection header received
0810 03:17:16.415072 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.415079 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.415297 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.415469 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.417104 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.418499 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.420739 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.422140 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.422276 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.422498 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.423200 (+ 702us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.423363 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6471,"thread_start_us":6365,"threads_started":1}
I20260810 03:17:16.423779 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.414955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:38709 (local address 127.0.0.1:59010)
0810 03:17:16.416635 (+ 1680us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.416653 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.416761 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.417597 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.417602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.417627 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.417980 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.417991 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.419765 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.419771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.421420 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.421432 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.423014 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.423021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.423184 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.423214 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.423295 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.423478 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1469,"thread_start_us":1312,"threads_started":1}
I20260810 03:17:16.424440 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.415315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59010 (local address 127.18.112.66:38709)
0810 03:17:16.416782 (+ 1467us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.416788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.416814 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:17:16.416922 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.416929 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.417132 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.417341 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.418161 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.419620 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.421589 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.422830 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.422944 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.423195 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.423363 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.423503 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1328,"thread_start_us":1208,"threads_started":1}
I20260810 03:17:16.424571 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.406034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:39003 (local address 127.0.0.1:41694)
0810 03:17:16.414573 (+ 8539us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.414628 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.414815 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.415837 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.415844 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.415900 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.416925 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.416935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.418574 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.418579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.420620 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.420635 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.422662 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.422668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.422919 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.422974 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.423996 (+ 1022us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.424165 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8417,"mutex_wait_us":602,"spinlock_wait_cycles":3840,"thread_start_us":8081,"threads_started":1}
I20260810 03:17:16.424610 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.405949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44855 (local address 127.0.0.1:46554)
0810 03:17:16.414573 (+ 8624us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.414628 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.414829 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.415851 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.415854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.415893 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.416445 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.416461 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.418675 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.418681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.420549 (+ 1868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.420568 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.422649 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.422656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.422889 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.422974 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.423996 (+ 1022us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.424165 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8365,"mutex_wait_us":122,"spinlock_wait_cycles":7168,"thread_start_us":8343,"threads_started":1}
I20260810 03:17:16.427887 13795 tablet_service.cc:1467] Processing CreateTablet for tablet 33390ea5faa447d5adcd71fc255f6704 (DEFAULT_TABLE table=test-table [id=472dfd810db447deb87875b6baf09481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:16.428021 13597 tablet_service.cc:1467] Processing CreateTablet for tablet 33390ea5faa447d5adcd71fc255f6704 (DEFAULT_TABLE table=test-table [id=472dfd810db447deb87875b6baf09481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:16.428737 13405 tablet_service.cc:1467] Processing CreateTablet for tablet 33390ea5faa447d5adcd71fc255f6704 (DEFAULT_TABLE table=test-table [id=472dfd810db447deb87875b6baf09481]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:16.429319 13795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33390ea5faa447d5adcd71fc255f6704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:16.429384 13597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33390ea5faa447d5adcd71fc255f6704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:16.429931 13405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33390ea5faa447d5adcd71fc255f6704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:16.439545 13915 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Bootstrap starting.
I20260810 03:17:16.442836 13915 tablet_bootstrap.cc:654] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:16.443027 13916 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Bootstrap starting.
I20260810 03:17:16.444978 13915 log.cc:824] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:16.446331 13919 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Bootstrap starting.
I20260810 03:17:16.446417 13916 tablet_bootstrap.cc:654] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:16.447600 13916 log.cc:824] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:16.447824 13915 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: No bootstrap required, opened a new log
I20260810 03:17:16.448087 13915 ts_tablet_manager.cc:1397] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260810 03:17:16.449499 13919 tablet_bootstrap.cc:654] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:16.450500 13916 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: No bootstrap required, opened a new log
I20260810 03:17:16.450655 13919 log.cc:824] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:16.450757 13916 ts_tablet_manager.cc:1397] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:17:16.454608 13919 tablet_bootstrap.cc:492] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: No bootstrap required, opened a new log
I20260810 03:17:16.454869 13919 ts_tablet_manager.cc:1397] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260810 03:17:16.456064 13915 raft_consensus.cc:348] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.456390 13915 raft_consensus.cc:374] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:16.456486 13915 raft_consensus.cc:729] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaae1428ae544b286c61baed4748356, State: Initialized, Role: FOLLOWER
I20260810 03:17:16.457011 13915 consensus_queue.cc:260] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.457993 13887 heartbeater.cc:503] Master 127.18.112.126:41677 was elected leader, sending a full tablet report...
I20260810 03:17:16.458576 13915 ts_tablet_manager.cc:1428] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Time spent starting tablet: real 0.010s user 0.003s sys 0.006s
I20260810 03:17:16.460323 13916 raft_consensus.cc:348] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.460711 13916 raft_consensus.cc:374] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:16.460811 13916 raft_consensus.cc:729] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ae98f54f7d4345a71429882236e101, State: Initialized, Role: FOLLOWER
I20260810 03:17:16.461354 13916 consensus_queue.cc:260] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.462313 13691 heartbeater.cc:503] Master 127.18.112.126:41677 was elected leader, sending a full tablet report...
I20260810 03:17:16.464056 13916 ts_tablet_manager.cc:1428] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260810 03:17:16.464416 13919 raft_consensus.cc:348] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.464784 13919 raft_consensus.cc:374] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:16.464893 13919 raft_consensus.cc:729] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b11821cd4d64bfdaf04d5d2139c9674, State: Initialized, Role: FOLLOWER
I20260810 03:17:16.465394 13919 consensus_queue.cc:260] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.466375 13502 heartbeater.cc:503] Master 127.18.112.126:41677 was elected leader, sending a full tablet report...
I20260810 03:17:16.466920 13919 ts_tablet_manager.cc:1428] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260810 03:17:16.521162 13503 tablet.cc:2369] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:17:16.610909 13888 tablet.cc:2369] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:16.625785 13933 raft_consensus.cc:482] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:16.626060 13933 raft_consensus.cc:504] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.627638 13933 leader_election.cc:288] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afaae1428ae544b286c61baed4748356 (127.18.112.67:39003), c8ae98f54f7d4345a71429882236e101 (127.18.112.66:38709)
I20260810 03:17:16.633466 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.628053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:45247 (local address 127.18.112.67:39003)
0810 03:17:16.628253 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.628259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.628603 (+ 344us) server_negotiation.cc:407] Connection header received
0810 03:17:16.628803 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.628807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.628867 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.628940 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.629422 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.630122 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.631873 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.632641 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.632784 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.632854 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.633107 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.633237 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:17:16.633824 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.628039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:53425 (local address 127.18.112.66:38709)
0810 03:17:16.628260 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.628266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.629062 (+ 796us) server_negotiation.cc:407] Connection header received
0810 03:17:16.629228 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.629233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.629296 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.629367 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.629889 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.630570 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.632272 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.633015 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.633163 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.633230 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.633476 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.633595 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:17:16.633832 13937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.627910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:39003 (local address 127.18.112.65:45247)
0810 03:17:16.628504 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.628523 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.628668 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.628980 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.628984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.629011 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.629293 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.629303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.630262 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.630266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.631667 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.631680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.632816 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.632822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.632964 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.632987 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.633066 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.633186 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":1,"spinlock_wait_cycles":7424,"thread_start_us":356,"threads_started":1}
I20260810 03:17:16.633924 13942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.628379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:38709 (local address 127.18.112.65:53425)
0810 03:17:16.628963 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.628977 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.629104 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.629396 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.629400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.629423 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.629751 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.629760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.630700 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.630704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.632106 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.632119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.633194 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.633201 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.633342 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.633365 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.633437 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.633554 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":3,"thread_start_us":294,"threads_started":1}
I20260810 03:17:16.634840 13926 raft_consensus.cc:482] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:16.634888 13627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ae98f54f7d4345a71429882236e101" is_pre_election: true
I20260810 03:17:16.634917 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaae1428ae544b286c61baed4748356" is_pre_election: true
I20260810 03:17:16.635325 13627 raft_consensus.cc:2454] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b11821cd4d64bfdaf04d5d2139c9674 in term 0.
I20260810 03:17:16.635182 13926 raft_consensus.cc:504] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.635885 13823 raft_consensus.cc:2454] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b11821cd4d64bfdaf04d5d2139c9674 in term 0.
I20260810 03:17:16.635958 13335 leader_election.cc:302] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b11821cd4d64bfdaf04d5d2139c9674, c8ae98f54f7d4345a71429882236e101; no voters:
I20260810 03:17:16.636328 13933 raft_consensus.cc:2781] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:16.636479 13933 raft_consensus.cc:482] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:16.636581 13933 raft_consensus.cc:3037] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:16.636905 13926 leader_election.cc:288] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b11821cd4d64bfdaf04d5d2139c9674 (127.18.112.65:44855), c8ae98f54f7d4345a71429882236e101 (127.18.112.66:38709)
I20260810 03:17:16.639873 13933 raft_consensus.cc:504] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.640489 13933 leader_election.cc:288] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [CANDIDATE]: Term 1 election: Requested vote from peers afaae1428ae544b286c61baed4748356 (127.18.112.67:39003), c8ae98f54f7d4345a71429882236e101 (127.18.112.66:38709)
I20260810 03:17:16.640897 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaae1428ae544b286c61baed4748356"
I20260810 03:17:16.640954 13627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ae98f54f7d4345a71429882236e101"
I20260810 03:17:16.641116 13823 raft_consensus.cc:3037] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:16.641117 13627 raft_consensus.cc:3037] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:16.644316 13823 raft_consensus.cc:2454] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b11821cd4d64bfdaf04d5d2139c9674 in term 1.
I20260810 03:17:16.644305 13627 raft_consensus.cc:2454] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b11821cd4d64bfdaf04d5d2139c9674 in term 1.
I20260810 03:17:16.644675 13330 leader_election.cc:302] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b11821cd4d64bfdaf04d5d2139c9674, afaae1428ae544b286c61baed4748356; no voters:
I20260810 03:17:16.644801 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.637309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:44855 (local address 127.18.112.67:37439)
0810 03:17:16.637873 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.637892 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.638004 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.638494 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.638497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.638517 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.638716 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.638730 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.640005 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.640010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.642454 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.642467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.644051 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.644057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.644266 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.644304 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.644386 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.644515 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":447}
I20260810 03:17:16.644865 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.637986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:42757 (local address 127.18.112.66:38709)
0810 03:17:16.638344 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.638349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.638368 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:17:16.638415 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.638420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.638477 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.638560 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.639109 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.639892 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.642546 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.643865 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.643980 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.644038 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.644481 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.644592 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255}
I20260810 03:17:16.644964 13933 raft_consensus.cc:2781] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:16.645372 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.637550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:37439 (local address 127.18.112.65:44855)
0810 03:17:16.637726 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.637730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.638075 (+ 345us) server_negotiation.cc:407] Connection header received
0810 03:17:16.638145 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.638150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.638242 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.638328 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:16.638876 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.639881 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.642616 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.643729 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.643900 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.643964 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.644992 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.645114 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:17:16.645426 13945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.637597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:38709 (local address 127.18.112.67:42757)
0810 03:17:16.638201 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:16.638217 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:16.638326 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:16.638589 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:16.638593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:16.638612 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:16.638967 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.638977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.640062 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.640070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.642294 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:16.642314 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.644171 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.644177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:16.644326 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.644351 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:17:16.644989 (+ 638us) client_negotiation.cc:240] Negotiation successful
0810 03:17:16.645110 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":2,"thread_start_us":478,"threads_started":1}
I20260810 03:17:16.645849 13933 raft_consensus.cc:686] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 1 LEADER]: Becoming Leader. State: Replica: 8b11821cd4d64bfdaf04d5d2139c9674, State: Running, Role: LEADER
I20260810 03:17:16.646036 13627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "afaae1428ae544b286c61baed4748356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ae98f54f7d4345a71429882236e101" is_pre_election: true
I20260810 03:17:16.646310 13627 raft_consensus.cc:2379] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afaae1428ae544b286c61baed4748356 in current term 1: Already voted for candidate 8b11821cd4d64bfdaf04d5d2139c9674 in this term.
I20260810 03:17:16.646211 13429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33390ea5faa447d5adcd71fc255f6704" candidate_uuid: "afaae1428ae544b286c61baed4748356" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" is_pre_election: true
I20260810 03:17:16.646420 13933 consensus_queue.cc:237] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } }
I20260810 03:17:16.647202 13725 leader_election.cc:302] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afaae1428ae544b286c61baed4748356; no voters: 8b11821cd4d64bfdaf04d5d2139c9674, c8ae98f54f7d4345a71429882236e101
I20260810 03:17:16.647578 13926 raft_consensus.cc:2726] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 03:17:16.651118 13220 catalog_manager.cc:5495] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b11821cd4d64bfdaf04d5d2139c9674 (127.18.112.65). New cstate: current_term: 1 leader_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b11821cd4d64bfdaf04d5d2139c9674" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 44855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 } health_report { overall_health: UNKNOWN } } }
W20260810 03:17:16.691226 13692 tablet.cc:2369] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:16.704730 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.699877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.18.112.65:44855)
0810 03:17:16.700034 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.700038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.700055 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:17:16.700205 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.700209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.700303 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.700418 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:16.700703 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.701422 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.702795 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.703193 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.703277 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.703655 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:16.704228 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:16.704351 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.704396 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.704453 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:17:16.711822 13627 raft_consensus.cc:1261] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 1 FOLLOWER]: Refusing update from remote peer 8b11821cd4d64bfdaf04d5d2139c9674: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:16.711977 13823 raft_consensus.cc:1261] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 1 FOLLOWER]: Refusing update from remote peer 8b11821cd4d64bfdaf04d5d2139c9674: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:16.712590 13949 consensus_queue.cc:1035] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ae98f54f7d4345a71429882236e101" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 38709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:16.712924 13933 consensus_queue.cc:1035] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afaae1428ae544b286c61baed4748356" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 39003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:16.740578 13219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:16.740931 13219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:16.744592 13219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c901b05a70f24e22843ece49ace36972: Sending DeleteTablet for 3 replicas of tablet 33390ea5faa447d5adcd71fc255f6704
I20260810 03:17:16.745700 13795 tablet_service.cc:1514] Processing DeleteTablet for tablet 33390ea5faa447d5adcd71fc255f6704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:16 UTC) from {username='slave'} at 127.0.0.1:41694
I20260810 03:17:16.745949 13405 tablet_service.cc:1514] Processing DeleteTablet for tablet 33390ea5faa447d5adcd71fc255f6704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:16 UTC) from {username='slave'} at 127.0.0.1:46554
I20260810 03:17:16.745934 13597 tablet_service.cc:1514] Processing DeleteTablet for tablet 33390ea5faa447d5adcd71fc255f6704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:16 UTC) from {username='slave'} at 127.0.0.1:59010
I20260810 03:17:16.747565 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 13309
I20260810 03:17:16.760923 13963 tablet_replica.cc:330] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: stopping tablet replica
I20260810 03:17:16.761410 13963 raft_consensus.cc:2229] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:16.761911 13963 raft_consensus.cc:2258] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:16.763437 13966 tablet_replica.cc:330] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: stopping tablet replica
I20260810 03:17:16.763835 13966 raft_consensus.cc:2229] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:16.764556 13966 raft_consensus.cc:2258] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:16.765107 13964 tablet_replica.cc:330] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: stopping tablet replica
I20260810 03:17:16.765455 13964 raft_consensus.cc:2229] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:16.765918 13964 raft_consensus.cc:2258] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:16.766255 13963 ts_tablet_manager.cc:1905] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:16.766587 13966 ts_tablet_manager.cc:1905] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:16.769042 13964 ts_tablet_manager.cc:1905] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:16.773066 13963 ts_tablet_manager.cc:1918] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:16.773226 13963 log.cc:1196] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/33390ea5faa447d5adcd71fc255f6704
I20260810 03:17:16.773706 13966 ts_tablet_manager.cc:1918] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:16.773767 13963 ts_tablet_manager.cc:1939] T 33390ea5faa447d5adcd71fc255f6704 P afaae1428ae544b286c61baed4748356: Deleting consensus metadata
I20260810 03:17:16.773895 13966 log.cc:1196] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/33390ea5faa447d5adcd71fc255f6704
I20260810 03:17:16.774415 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.749048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46576 (local address 127.18.112.65:44855)
0810 03:17:16.749230 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.749237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.762793 (+ 13556us) server_negotiation.cc:407] Connection header received
0810 03:17:16.762978 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.762984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.763122 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.763258 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:16.764093 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.765256 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.769301 (+ 4045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.769961 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.770053 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.771991 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:16.772002 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:16.772022 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:16.772778 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:16.772852 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:16.772875 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:16.772956 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.773966 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.774067 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:17:16.774477 13966 ts_tablet_manager.cc:1939] T 33390ea5faa447d5adcd71fc255f6704 P 8b11821cd4d64bfdaf04d5d2139c9674: Deleting consensus metadata
I20260810 03:17:16.775651 13494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:16.776041 13196 catalog_manager.cc:4841] TS 8b11821cd4d64bfdaf04d5d2139c9674 (127.18.112.65:44855): tablet 33390ea5faa447d5adcd71fc255f6704 (table test-table [id=472dfd810db447deb87875b6baf09481]) successfully deleted
I20260810 03:17:16.776070 13192 catalog_manager.cc:4841] TS afaae1428ae544b286c61baed4748356 (127.18.112.67:39003): tablet 33390ea5faa447d5adcd71fc255f6704 (table test-table [id=472dfd810db447deb87875b6baf09481]) successfully deleted
I20260810 03:17:16.780884 13964 ts_tablet_manager.cc:1918] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:16.781023 13964 log.cc:1196] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/33390ea5faa447d5adcd71fc255f6704
I20260810 03:17:16.781420 13964 ts_tablet_manager.cc:1939] T 33390ea5faa447d5adcd71fc255f6704 P c8ae98f54f7d4345a71429882236e101: Deleting consensus metadata
I20260810 03:17:16.782657 13196 catalog_manager.cc:4841] TS c8ae98f54f7d4345a71429882236e101 (127.18.112.66:38709): tablet 33390ea5faa447d5adcd71fc255f6704 (table test-table [id=472dfd810db447deb87875b6baf09481]) successfully deleted
I20260810 03:17:16.872126 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 13309
I20260810 03:17:16.894068 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 13506
I20260810 03:17:16.900810 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:16.894805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59014 (local address 127.18.112.66:38709)
0810 03:17:16.894971 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:16.894977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:16.894996 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:17:16.895192 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:16.895198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:16.895291 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:16.895377 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:16.895795 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.896614 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.897887 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:16.898287 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:16.898404 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:16.899365 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:16.899374 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:16.899388 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:16.900132 (+ 744us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:16.900188 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:16.900212 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:16.900310 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:16.900441 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 03:17:16.900538 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:17:16.901382 13685 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:16.985849 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 13506
I20260810 03:17:17.006834 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 13694
I20260810 03:17:17.014081 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:17.007556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.18.112.67:39003)
0810 03:17:17.007735 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:17.007740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:17.007912 (+ 172us) server_negotiation.cc:407] Connection header received
0810 03:17:17.008079 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:17.008083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:17.008176 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:17.008258 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:17.008672 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:17.009386 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:17.011158 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:17.011532 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:17.011620 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:17.012823 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:17.012833 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:17.012848 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:17.013401 (+ 553us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:17.013447 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:17.013466 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:17.013549 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:17.013688 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 03:17:17.013777 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:17:17.014696 13880 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:17.101227 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 13694
I20260810 03:17:17.123338 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 13167
I20260810 03:17:17.124392 13268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:17.227525 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 13167
2026-08-10T03:17:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2717 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:17 dist-test-slave-jlzn krb5kdc[13982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:17 dist-test-slave-jlzn krb5kdc[13982](info): set up 2 sockets
Aug 10 03:17:17 dist-test-slave-jlzn krb5kdc[13982](info): commencing operation
krb5kdc: starting...
W20260810 03:17:18.431313 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:18 dist-test-slave-jlzn krb5kdc[13982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:17:18.690783 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33921
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:33631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33921
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:19.017724 13998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:19.017995 13998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:19.018118 13998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:19.025136 13998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:19.025231 13998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:19.025311 13998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:19.025378 13998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:19.025434 13998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:19.034804 13998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:33631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:19.036052 13998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:19.037259 13998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:19.048265 14005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:19.048328 14009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:19.048316 14003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:19.049139 13998 server_base.cc:1034] running on GCE node
I20260810 03:17:19.049806 13998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:19.050992 13998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:19.052175 13998 hybrid_clock.cc:648] HybridClock initialized: now 1786331839052120 us; error 47 us; skew 500 ppm
I20260810 03:17:19.052498 13998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:19 dist-test-slave-jlzn krb5kdc[13982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:19.055624 13998 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:17:19.056985 13998 webserver.cc:460] Webserver started at http://127.18.112.126:44307/ using document root <none> and password file <none>
I20260810 03:17:19.057605 13998 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:19.057724 13998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:19.058005 13998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:19.060830 13998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "bdd507cf51504b9bb1b1d88d5f23f53c"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "1faf1dd853789f12875afe325e4e720d"
server_key_iv: "bd443050346cd4e3675f41a41e76d1ed"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.061544 13998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "bdd507cf51504b9bb1b1d88d5f23f53c"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "1faf1dd853789f12875afe325e4e720d"
server_key_iv: "bd443050346cd4e3675f41a41e76d1ed"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.066375 13998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 03:17:19.069527 14017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:19.070698 13998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:17:19.070868 13998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "bdd507cf51504b9bb1b1d88d5f23f53c"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "1faf1dd853789f12875afe325e4e720d"
server_key_iv: "bd443050346cd4e3675f41a41e76d1ed"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.071038 13998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:19.085122 13998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:19.088554 13998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:19.088798 13998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:19.105305 13998 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:33921
I20260810 03:17:19.105334 14099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:33921 every 8 connection(s)
I20260810 03:17:19.106468 13998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:19.109848 14100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:19.113749 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 13998
I20260810 03:17:19.113907 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:19.114334 18881 external_mini_cluster.cc:1428] Setting key 358537f27952b538ad70d41874645827
I20260810 03:17:19.121134 14100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: Bootstrap starting.
I20260810 03:17:19.124485 14100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:19.125509 14100 log.cc:824] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:19.128290 14100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: No bootstrap required, opened a new log
Aug 10 03:17:19 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:19.137848 14100 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } }
I20260810 03:17:19.138249 14100 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:19.138311 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:19.115904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47210 (local address 127.18.112.126:33921)
0810 03:17:19.116689 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:19.116703 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:19.116750 (+ 47us) server_negotiation.cc:407] Connection header received
0810 03:17:19.119542 (+ 2792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:19.119568 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:19.120020 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:19.120432 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:19.121850 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.123827 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.125157 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.126222 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.126349 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:19.130288 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:19.130298 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:19.130315 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:19.130361 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:19.134221 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:19.134845 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:19.134857 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:19.134864 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:19.135063 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:19.135385 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:19.135390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:19.135394 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:19.136107 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:19.136394 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:19.136695 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 03:17:19.137096 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":333,"threads_started":1}
I20260810 03:17:19.138373 14100 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdd507cf51504b9bb1b1d88d5f23f53c, State: Initialized, Role: FOLLOWER
I20260810 03:17:19.138936 14100 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } }
I20260810 03:17:19.139164 14100 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:19.139297 14100 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:19.139467 14100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:19.141742 14100 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } }
I20260810 03:17:19.142220 14100 leader_election.cc:302] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdd507cf51504b9bb1b1d88d5f23f53c; no voters:
I20260810 03:17:19.142848 14100 leader_election.cc:288] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:19.142979 14110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:19.143661 14110 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [term 1 LEADER]: Becoming Leader. State: Replica: bdd507cf51504b9bb1b1d88d5f23f53c, State: Running, Role: LEADER
I20260810 03:17:19.144191 14110 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } }
I20260810 03:17:19.144793 14100 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:19.146831 14111 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } } }
I20260810 03:17:19.146802 14112 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdd507cf51504b9bb1b1d88d5f23f53c. Latest consensus state: current_term: 1 leader_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd507cf51504b9bb1b1d88d5f23f53c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33921 } } }
I20260810 03:17:19.147215 14111 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:19.147215 14112 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:19.150305 14116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:19.154904 14116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:19.163393 14116 catalog_manager.cc:1347] Generated new cluster ID: 0cb14541b50e421f807afba1c781301f
I20260810 03:17:19.163484 14116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:19.181052 14116 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:19.182195 14116 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:19.190850 14116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: Generated new TSK 0
I20260810 03:17:19.191504 14116 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:17:19.257283 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:33631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:19.572018 14143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:19.572256 14143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:19.572350 14143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:19.579531 14143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:19.579629 14143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:19.579746 14143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:19.588755 14143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:33631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:19.589758 14143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:19.590898 14143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:19.602881 14154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:19.602835 14149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:19.602914 14151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:19.603653 14143 server_base.cc:1034] running on GCE node
I20260810 03:17:19.604202 14143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:19.605015 14143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:19.606216 14143 hybrid_clock.cc:648] HybridClock initialized: now 1786331839606167 us; error 33 us; skew 500 ppm
I20260810 03:17:19.606495 14143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:19 dist-test-slave-jlzn krb5kdc[13982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:19.609387 14143 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:17:19.610615 14143 webserver.cc:460] Webserver started at http://127.18.112.65:45453/ using document root <none> and password file <none>
I20260810 03:17:19.611215 14143 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:19.611332 14143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:19.611632 14143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:19.614317 14143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "32f6f7a812334466a59f77c714ea87fa"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "39389cd743b28cf83c06f91e274bded8"
server_key_iv: "e1b28b95d866e21d46081568e3adc9c2"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.615039 14143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "32f6f7a812334466a59f77c714ea87fa"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "39389cd743b28cf83c06f91e274bded8"
server_key_iv: "e1b28b95d866e21d46081568e3adc9c2"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.619835 14143 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:17:19.622969 14163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:19.624184 14143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260810 03:17:19.624325 14143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "32f6f7a812334466a59f77c714ea87fa"
format_stamp: "Formatted at 2026-08-10 03:17:19 on dist-test-slave-jlzn"
server_key: "39389cd743b28cf83c06f91e274bded8"
server_key_iv: "e1b28b95d866e21d46081568e3adc9c2"
server_key_version: "encryptionkey@0"
I20260810 03:17:19.624490 14143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:19.636132 14143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:19.639554 14143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:19.639827 14143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:19.640654 14143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:19.641827 14143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:19.641904 14143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:19.642019 14143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:19.642073 14143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:19.671108 14143 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:41275
I20260810 03:17:19.671152 14336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:41275 every 8 connection(s)
I20260810 03:17:19.672295 14143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:19.678651 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 14143
I20260810 03:17:19.678833 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:19.679370 18881 external_mini_cluster.cc:1428] Setting key 1312b6fd6998a6d2162cd3340d61f4f2
Aug 10 03:17:19 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331839, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:19.691754 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:19.674476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:43657 (local address 127.18.112.126:33921)
0810 03:17:19.674891 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:19.674896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:19.675846 (+ 950us) server_negotiation.cc:407] Connection header received
0810 03:17:19.677599 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:19.677604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:19.677682 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:19.677781 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:19.679555 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.680361 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.682317 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.682709 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.682802 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:19.686468 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:19.686473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:19.686476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:19.686508 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:19.688847 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:19.689582 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:19.689585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:19.689587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:19.689697 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:19.690123 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:19.690127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:19.690130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:19.690394 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:19.690558 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:19.691206 (+ 648us) server_negotiation.cc:299] Negotiation successful
0810 03:17:19.691406 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":203,"threads_started":1}
I20260810 03:17:19.692458 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:19.674982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33921 (local address 127.18.112.65:43657)
0810 03:17:19.675700 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:19.675736 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:19.677351 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:19.678004 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:19.678011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:19.678647 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:19.679378 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:19.679404 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.680519 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.680523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:19.682165 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:19.682180 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:19.682916 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:19.682923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:19.683187 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:19.683846 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:19.683878 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:19.686259 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:19.688975 (+ 2716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:19.688983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:19.688997 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:19.689492 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:19.689781 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:19.689785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:19.689788 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:19.690004 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:19.690524 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:19.690532 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:19.690810 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 03:17:19.691096 (+ 286us) client_negotiation.cc:240] Negotiation successful
0810 03:17:19.691450 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":256,"threads_started":1}
I20260810 03:17:19.693881 14337 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33921
I20260810 03:17:19.694195 14337 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:19.694967 14337 heartbeater.cc:511] Master 127.18.112.126:33921 requested a full tablet report, sending...
I20260810 03:17:19.696913 14043 ts_manager.cc:194] Registered new tserver with Master: 32f6f7a812334466a59f77c714ea87fa (127.18.112.65:41275)
I20260810 03:17:19.698251 14043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:43657
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:17:19.737883 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:33631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:20.048492 14351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:20.048733 14351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:20.048830 14351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:20.056015 14351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:20.056133 14351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:20.056298 14351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:20.065440 14351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:33631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:20.066525 14351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:20.067719 14351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:20.079732 14359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:20.079759 14358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:20.079888 14361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:20.080309 14351 server_base.cc:1034] running on GCE node
I20260810 03:17:20.080961 14351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:20.081780 14351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:20.082968 14351 hybrid_clock.cc:648] HybridClock initialized: now 1786331840082924 us; error 35 us; skew 500 ppm
I20260810 03:17:20.083237 14351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:20 dist-test-slave-jlzn krb5kdc[13982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331840, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:20.090837 14351 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:17:20.092163 14351 webserver.cc:460] Webserver started at http://127.18.112.66:33663/ using document root <none> and password file <none>
I20260810 03:17:20.092753 14351 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:20.092866 14351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:20.093150 14351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:20.095747 14351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "045b2c95aa9a4f428c787a6e1f4f697c"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "ff0e25f2f28e0275a72bd05e9aaee693"
server_key_iv: "b7a196d35c822928d1f36766b4183cac"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.096550 14351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "045b2c95aa9a4f428c787a6e1f4f697c"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "ff0e25f2f28e0275a72bd05e9aaee693"
server_key_iv: "b7a196d35c822928d1f36766b4183cac"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.101146 14351 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:17:20.104343 14370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.105549 14351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:20.105710 14351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "045b2c95aa9a4f428c787a6e1f4f697c"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "ff0e25f2f28e0275a72bd05e9aaee693"
server_key_iv: "b7a196d35c822928d1f36766b4183cac"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.105877 14351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:20.127251 14351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:20.130754 14351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:20.130991 14351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:20.131870 14351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:20.133038 14351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:20.133117 14351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.133239 14351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:20.133293 14351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.161751 14351 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:39643
I20260810 03:17:20.161808 14547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:39643 every 8 connection(s)
I20260810 03:17:20.162897 14351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:20.167552 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 14351
I20260810 03:17:20.167723 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:20.168293 18881 external_mini_cluster.cc:1428] Setting key d5240fd8d8a4285f8d01fa74b084ccb9
Aug 10 03:17:20 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331840, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:20.183581 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.165157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:35453 (local address 127.18.112.126:33921)
0810 03:17:20.165322 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.165327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.166408 (+ 1081us) server_negotiation.cc:407] Connection header received
0810 03:17:20.168575 (+ 2167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.168580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.168651 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.168731 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:20.170423 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.171153 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.173220 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.173599 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.173686 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.177383 (+ 3697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:20.177390 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:20.177395 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:20.177433 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:20.180587 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.181339 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.181344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.181348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.181517 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.181916 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.181920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.181922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.182250 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:20.182387 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.183063 (+ 676us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.183277 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:17:20.184418 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.165590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33921 (local address 127.18.112.66:35453)
0810 03:17:20.166260 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.166302 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.168290 (+ 1988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.168959 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.168967 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.169591 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:20.170240 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.170266 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.171304 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.171309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.173102 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.173117 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.173795 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.173801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.174050 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.174697 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:20.174724 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:20.177164 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:20.180718 (+ 3554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:20.180726 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:20.180739 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:20.181208 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:20.181617 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:20.181621 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:20.181624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:20.181811 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:20.182360 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:20.182366 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:20.182689 (+ 323us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.182919 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.183320 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":259,"threads_started":1}
I20260810 03:17:20.185672 14548 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33921
I20260810 03:17:20.185981 14548 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:20.186797 14548 heartbeater.cc:511] Master 127.18.112.126:33921 requested a full tablet report, sending...
I20260810 03:17:20.188406 14043 ts_manager.cc:194] Registered new tserver with Master: 045b2c95aa9a4f428c787a6e1f4f697c (127.18.112.66:39643)
I20260810 03:17:20.189181 14043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:35453
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:17:20.229076 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:33631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:20.542654 14555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:20.542891 14555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:20.543027 14555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:20.549942 14555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:20.550050 14555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:20.550196 14555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:20.559324 14555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:33631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:33921
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:20.560422 14555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:20.561635 14555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:20.573738 14565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:20.573776 14563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:20.573855 14562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:20.574656 14555 server_base.cc:1034] running on GCE node
I20260810 03:17:20.575268 14555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:20.576165 14555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:20.577358 14555 hybrid_clock.cc:648] HybridClock initialized: now 1786331840577317 us; error 34 us; skew 500 ppm
I20260810 03:17:20.577631 14555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:20 dist-test-slave-jlzn krb5kdc[13982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331840, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:20.580600 14555 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:17:20.581817 14555 webserver.cc:460] Webserver started at http://127.18.112.67:33693/ using document root <none> and password file <none>
I20260810 03:17:20.582398 14555 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:20.582504 14555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:20.582751 14555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:20.585390 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "fc3407fa05f0464e9653b454b2824f6a"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "0c544a495ca949fbd83e0462ba167a80"
server_key_iv: "474433e12b29e7b19e5d76b153289c99"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.586094 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "fc3407fa05f0464e9653b454b2824f6a"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "0c544a495ca949fbd83e0462ba167a80"
server_key_iv: "474433e12b29e7b19e5d76b153289c99"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.590737 14555 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 03:17:20.593940 14582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.595086 14555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:17:20.595229 14555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "fc3407fa05f0464e9653b454b2824f6a"
format_stamp: "Formatted at 2026-08-10 03:17:20 on dist-test-slave-jlzn"
server_key: "0c544a495ca949fbd83e0462ba167a80"
server_key_iv: "474433e12b29e7b19e5d76b153289c99"
server_key_version: "encryptionkey@0"
I20260810 03:17:20.595393 14555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:20.608675 14555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:20.612504 14555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:20.612754 14555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:20.613581 14555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:20.614763 14555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:20.614835 14555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.614945 14555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:20.614998 14555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:20.644328 14555 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:36133
I20260810 03:17:20.644392 14770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:36133 every 8 connection(s)
I20260810 03:17:20.645538 14555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:20.650296 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 14555
I20260810 03:17:20.650471 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:20.651019 18881 external_mini_cluster.cc:1428] Setting key 267e6063768363d1f2142e48903c50aa
Aug 10 03:17:20 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331840, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:20.663861 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.647925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:46089 (local address 127.18.112.126:33921)
0810 03:17:20.648161 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.648167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.649264 (+ 1097us) server_negotiation.cc:407] Connection header received
0810 03:17:20.651401 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.651406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.651491 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.651622 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:20.653291 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.654221 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.655669 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.656106 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.656198 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.659183 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:20.659188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:20.659191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:20.659223 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:20.661536 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.662136 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.662139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.662142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.662253 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.662568 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.662571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.662573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.662822 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:20.662931 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.663430 (+ 499us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.663586 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:17:20.664841 14778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.648417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:33921 (local address 127.18.112.67:46089)
0810 03:17:20.649099 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.649154 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.651114 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.651878 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.651889 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.652495 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:20.653129 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.653149 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.654367 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.654371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.655557 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.655569 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.656269 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.656274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.656454 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.656988 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:20.657009 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:20.658998 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:20.661661 (+ 2663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:20.661667 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:20.661677 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:20.662047 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:20.662324 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:20.662327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:20.662329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:20.662493 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:20.662909 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:20.662914 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:20.663173 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.663372 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.663711 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":265,"threads_started":1}
I20260810 03:17:20.666102 14771 heartbeater.cc:347] Connected to a master server at 127.18.112.126:33921
I20260810 03:17:20.666340 14771 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:20.666941 14771 heartbeater.cc:511] Master 127.18.112.126:33921 requested a full tablet report, sending...
I20260810 03:17:20.668212 14038 ts_manager.cc:194] Registered new tserver with Master: fc3407fa05f0464e9653b454b2824f6a (127.18.112.67:36133)
I20260810 03:17:20.669019 14038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:46089
I20260810 03:17:20.677757 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:20.693192 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.681532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47214 (local address 127.18.112.126:33921)
0810 03:17:20.681666 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.681670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.682124 (+ 454us) server_negotiation.cc:407] Connection header received
0810 03:17:20.682258 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.682261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.682312 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.682377 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:20.683794 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.684485 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.685797 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.686194 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.686275 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.688590 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:20.688595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:20.688598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:20.688625 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:20.690942 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.691600 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.691603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.691605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.691722 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.692090 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.692093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.692095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.692356 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:20.692541 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.692855 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.692974 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 03:17:20.701262 14337 heartbeater.cc:503] Master 127.18.112.126:33921 was elected leader, sending a full tablet report...
I20260810 03:17:20.696501 14038 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:20.703321 14038 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:20.723917 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.714424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34102 (local address 127.18.112.65:41275)
0810 03:17:20.716552 (+ 2128us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.716560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.716588 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:17:20.716676 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.716683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.716911 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.717854 (+ 943us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:20.718048 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.719242 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.721714 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.722787 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.722931 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.723164 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.723413 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.723575 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1971,"thread_start_us":1822,"threads_started":1}
I20260810 03:17:20.723946 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.714304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:41275 (local address 127.0.0.1:34102)
0810 03:17:20.715068 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.715107 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.715289 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.717155 (+ 1866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.717164 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.717198 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:20.717715 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.717731 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.719354 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.719359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.721563 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.721575 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.722989 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.722995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.723185 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.723235 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.723342 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.723509 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":214,"thread_start_us":1255,"threads_started":1}
I20260810 03:17:20.725023 14796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.714352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:39643 (local address 127.0.0.1:45374)
0810 03:17:20.715884 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.715902 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.716012 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.718407 (+ 2395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.718411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.718436 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:20.718774 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.718785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.720601 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.720606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.722605 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.722615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.724312 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.724320 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.724476 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.724508 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.724574 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.724699 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1365,"thread_start_us":673,"threads_started":1}
I20260810 03:17:20.725487 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.715820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:36133 (local address 127.0.0.1:57286)
0810 03:17:20.716316 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.716332 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.716436 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.717498 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.717503 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.717531 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:20.717966 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.717978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.720012 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.720018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.722241 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.722256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.724837 (+ 2581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.724844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.725001 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.725036 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.725117 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.725240 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":751,"threads_started":1}
I20260810 03:17:20.726080 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.716338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.18.112.67:36133)
0810 03:17:20.716961 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.716968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.716995 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:17:20.717081 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.717087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.717291 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.718162 (+ 871us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:20.718418 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.719860 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.722424 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.724635 (+ 2211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.724748 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.724953 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.725720 (+ 767us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.725831 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":355,"threads_started":1}
I20260810 03:17:20.727041 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.714848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.18.112.66:39643)
0810 03:17:20.717879 (+ 3031us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.717888 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.717913 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:17:20.718000 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.718007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.718213 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.718400 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:20.718940 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.720442 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.722758 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.724079 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.725373 (+ 1294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.725555 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.725770 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.725927 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2875,"thread_start_us":2745,"threads_started":1}
I20260810 03:17:20.728166 14234 tablet_service.cc:1467] Processing CreateTablet for tablet 9da394d507dd49a781e2a208f05a6e89 (DEFAULT_TABLE table=test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:20.729693 14234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da394d507dd49a781e2a208f05a6e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:20.729307 14666 tablet_service.cc:1467] Processing CreateTablet for tablet 9da394d507dd49a781e2a208f05a6e89 (DEFAULT_TABLE table=test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:20.730399 14666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da394d507dd49a781e2a208f05a6e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:20.730412 14444 tablet_service.cc:1467] Processing CreateTablet for tablet 9da394d507dd49a781e2a208f05a6e89 (DEFAULT_TABLE table=test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:20.731698 14444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da394d507dd49a781e2a208f05a6e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:20.740377 14809 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Bootstrap starting.
I20260810 03:17:20.743636 14810 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Bootstrap starting.
I20260810 03:17:20.744463 14809 tablet_bootstrap.cc:654] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:20.745718 14809 log.cc:824] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:20.747083 14811 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Bootstrap starting.
I20260810 03:17:20.748121 14810 tablet_bootstrap.cc:654] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:20.748607 14809 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: No bootstrap required, opened a new log
I20260810 03:17:20.748843 14809 ts_tablet_manager.cc:1397] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260810 03:17:20.749284 14810 log.cc:824] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:20.750268 14811 tablet_bootstrap.cc:654] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:20.751456 14811 log.cc:824] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:20.752242 14810 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: No bootstrap required, opened a new log
I20260810 03:17:20.752490 14810 ts_tablet_manager.cc:1397] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 03:17:20.754344 14811 tablet_bootstrap.cc:492] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: No bootstrap required, opened a new log
I20260810 03:17:20.754643 14811 ts_tablet_manager.cc:1397] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260810 03:17:20.756570 14809 raft_consensus.cc:348] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.756896 14809 raft_consensus.cc:374] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:20.756996 14809 raft_consensus.cc:729] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3407fa05f0464e9653b454b2824f6a, State: Initialized, Role: FOLLOWER
I20260810 03:17:20.757529 14809 consensus_queue.cc:260] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.758502 14771 heartbeater.cc:503] Master 127.18.112.126:33921 was elected leader, sending a full tablet report...
I20260810 03:17:20.758983 14809 ts_tablet_manager.cc:1428] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260810 03:17:20.762302 14810 raft_consensus.cc:348] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.762705 14810 raft_consensus.cc:374] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:20.762811 14810 raft_consensus.cc:729] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32f6f7a812334466a59f77c714ea87fa, State: Initialized, Role: FOLLOWER
I20260810 03:17:20.763463 14810 consensus_queue.cc:260] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.765038 14810 ts_tablet_manager.cc:1428] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260810 03:17:20.766116 14811 raft_consensus.cc:348] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.766464 14811 raft_consensus.cc:374] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:20.766551 14811 raft_consensus.cc:729] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045b2c95aa9a4f428c787a6e1f4f697c, State: Initialized, Role: FOLLOWER
I20260810 03:17:20.767042 14811 consensus_queue.cc:260] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.767972 14548 heartbeater.cc:503] Master 127.18.112.126:33921 was elected leader, sending a full tablet report...
I20260810 03:17:20.768500 14811 ts_tablet_manager.cc:1428] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
I20260810 03:17:20.873893 14818 raft_consensus.cc:482] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:20.874220 14818 raft_consensus.cc:504] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.876191 14818 leader_election.cc:288] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 045b2c95aa9a4f428c787a6e1f4f697c (127.18.112.66:39643), fc3407fa05f0464e9653b454b2824f6a (127.18.112.67:36133)
I20260810 03:17:20.883034 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.876518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:45883 (local address 127.18.112.66:39643)
0810 03:17:20.876714 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.876719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.877320 (+ 601us) server_negotiation.cc:407] Connection header received
0810 03:17:20.877485 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.877491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.877554 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.877632 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:20.878661 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.879510 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.881374 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.882123 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.882259 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.882334 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.882664 (+ 330us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.882788 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:17:20.883090 14823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.876543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:39643 (local address 127.18.112.65:45883)
0810 03:17:20.877175 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.877201 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.877349 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.877806 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.877811 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.877842 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:20.878243 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.878255 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.879629 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.879635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.881225 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.881237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.882317 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.882323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.882510 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.882535 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.882622 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.882743 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":318,"threads_started":1}
I20260810 03:17:20.883234 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.877524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:34559 (local address 127.18.112.67:36133)
0810 03:17:20.877747 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.877752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.878243 (+ 491us) server_negotiation.cc:407] Connection header received
0810 03:17:20.878380 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.878385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.878452 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.878518 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:20.879043 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.879836 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.881577 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.882347 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.882498 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.882573 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.882889 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.883008 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:17:20.883580 14826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.877232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:36133 (local address 127.18.112.65:34559)
0810 03:17:20.878144 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:20.878160 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:20.878272 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:20.878533 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:20.878536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:20.878552 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:20.878874 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.878885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.879968 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.879974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.881423 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:20.881436 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.882613 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.882620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:20.882741 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.882763 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:17:20.882843 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:17:20.882964 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"mutex_wait_us":20,"thread_start_us":510,"threads_started":1}
I20260810 03:17:20.884286 14474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da394d507dd49a781e2a208f05a6e89" candidate_uuid: "32f6f7a812334466a59f77c714ea87fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" is_pre_election: true
I20260810 03:17:20.884503 14704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da394d507dd49a781e2a208f05a6e89" candidate_uuid: "32f6f7a812334466a59f77c714ea87fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3407fa05f0464e9653b454b2824f6a" is_pre_election: true
I20260810 03:17:20.884737 14474 raft_consensus.cc:2454] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32f6f7a812334466a59f77c714ea87fa in term 0.
I20260810 03:17:20.884975 14704 raft_consensus.cc:2454] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32f6f7a812334466a59f77c714ea87fa in term 0.
I20260810 03:17:20.885370 14166 leader_election.cc:302] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045b2c95aa9a4f428c787a6e1f4f697c, 32f6f7a812334466a59f77c714ea87fa; no voters:
I20260810 03:17:20.885743 14818 raft_consensus.cc:2781] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:20.885867 14818 raft_consensus.cc:482] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:20.885968 14818 raft_consensus.cc:3037] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:20.888119 14818 raft_consensus.cc:504] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
I20260810 03:17:20.888636 14818 leader_election.cc:288] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [CANDIDATE]: Term 1 election: Requested vote from peers 045b2c95aa9a4f428c787a6e1f4f697c (127.18.112.66:39643), fc3407fa05f0464e9653b454b2824f6a (127.18.112.67:36133)
I20260810 03:17:20.889050 14474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da394d507dd49a781e2a208f05a6e89" candidate_uuid: "32f6f7a812334466a59f77c714ea87fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045b2c95aa9a4f428c787a6e1f4f697c"
I20260810 03:17:20.889133 14704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da394d507dd49a781e2a208f05a6e89" candidate_uuid: "32f6f7a812334466a59f77c714ea87fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3407fa05f0464e9653b454b2824f6a"
I20260810 03:17:20.889228 14474 raft_consensus.cc:3037] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:20.889314 14704 raft_consensus.cc:3037] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:20.891326 14474 raft_consensus.cc:2454] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32f6f7a812334466a59f77c714ea87fa in term 1.
I20260810 03:17:20.891381 14704 raft_consensus.cc:2454] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32f6f7a812334466a59f77c714ea87fa in term 1.
I20260810 03:17:20.891667 14166 leader_election.cc:302] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045b2c95aa9a4f428c787a6e1f4f697c, 32f6f7a812334466a59f77c714ea87fa; no voters:
I20260810 03:17:20.891916 14818 raft_consensus.cc:2781] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:20.892313 14818 raft_consensus.cc:686] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 1 LEADER]: Becoming Leader. State: Replica: 32f6f7a812334466a59f77c714ea87fa, State: Running, Role: LEADER
I20260810 03:17:20.892742 14818 consensus_queue.cc:237] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } }
W20260810 03:17:20.897037 14777 tablet.cc:2369] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:20.896759 14038 catalog_manager.cc:5495] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 32f6f7a812334466a59f77c714ea87fa (127.18.112.65). New cstate: current_term: 1 leader_uuid: "32f6f7a812334466a59f77c714ea87fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32f6f7a812334466a59f77c714ea87fa" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 } health_report { overall_health: UNKNOWN } } }
W20260810 03:17:20.914731 14549 tablet.cc:2369] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:20.921949 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.917296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.18.112.65:41275)
0810 03:17:20.917459 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.917463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.917597 (+ 134us) server_negotiation.cc:407] Connection header received
0810 03:17:20.917756 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.917759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.917829 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.917940 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:20.918261 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.918944 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.920237 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.920608 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.920704 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.921077 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:20.921535 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:20.921658 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.921730 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.921768 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 03:17:20.924614 14341 tablet.cc:2369] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:20.929656 14474 raft_consensus.cc:1261] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 1 FOLLOWER]: Refusing update from remote peer 32f6f7a812334466a59f77c714ea87fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:20.929668 14704 raft_consensus.cc:1261] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 1 FOLLOWER]: Refusing update from remote peer 32f6f7a812334466a59f77c714ea87fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:20.930469 14827 consensus_queue.cc:1035] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3407fa05f0464e9653b454b2824f6a" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:20.930773 14818 consensus_queue.cc:1035] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "045b2c95aa9a4f428c787a6e1f4f697c" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:20.942922 14831 mvcc.cc:205] Tried to move back new op lower bound from 7316815220439044096 to 7316815220299919360. Current Snapshot: MvccSnapshot[applied={T|T < 7316815220439044096}]
I20260810 03:17:20.952805 14043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:20.953040 14043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:20.956364 14043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdd507cf51504b9bb1b1d88d5f23f53c: Sending DeleteTablet for 3 replicas of tablet 9da394d507dd49a781e2a208f05a6e89
I20260810 03:17:20.957376 14234 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da394d507dd49a781e2a208f05a6e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:20 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:34102
I20260810 03:17:20.957548 14666 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da394d507dd49a781e2a208f05a6e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:20 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:57286
I20260810 03:17:20.957803 14444 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da394d507dd49a781e2a208f05a6e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:20 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:45374
I20260810 03:17:20.958341 14850 tablet_replica.cc:330] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: stopping tablet replica
I20260810 03:17:20.958693 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 14143
I20260810 03:17:20.958827 14850 raft_consensus.cc:2229] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:20.959496 14850 raft_consensus.cc:2258] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:20.959954 14853 tablet_replica.cc:330] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: stopping tablet replica
I20260810 03:17:20.960314 14853 raft_consensus.cc:2229] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:20.960752 14853 raft_consensus.cc:2258] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:20.962744 14853 ts_tablet_manager.cc:1905] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:20.969547 14853 ts_tablet_manager.cc:1918] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:20.969758 14853 log.cc:1196] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/9da394d507dd49a781e2a208f05a6e89
I20260810 03:17:20.970551 14850 ts_tablet_manager.cc:1905] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:20.970780 14855 tablet_replica.cc:330] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: stopping tablet replica
I20260810 03:17:20.970822 14853 ts_tablet_manager.cc:1939] T 9da394d507dd49a781e2a208f05a6e89 P fc3407fa05f0464e9653b454b2824f6a: Deleting consensus metadata
I20260810 03:17:20.971165 14855 raft_consensus.cc:2229] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:20.971619 14855 raft_consensus.cc:2258] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:20.972819 14022 catalog_manager.cc:4841] TS fc3407fa05f0464e9653b454b2824f6a (127.18.112.67:36133): tablet 9da394d507dd49a781e2a208f05a6e89 (table test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]) successfully deleted
Aug 10 03:17:20 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:17:20.976274 14855 ts_tablet_manager.cc:1905] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:20.977859 14850 ts_tablet_manager.cc:1918] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:20.978006 14850 log.cc:1196] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-0/wal/wals/9da394d507dd49a781e2a208f05a6e89
I20260810 03:17:20.978543 14850 ts_tablet_manager.cc:1939] T 9da394d507dd49a781e2a208f05a6e89 P 32f6f7a812334466a59f77c714ea87fa: Deleting consensus metadata
I20260810 03:17:20.980207 14024 catalog_manager.cc:4841] TS 32f6f7a812334466a59f77c714ea87fa (127.18.112.65:41275): tablet 9da394d507dd49a781e2a208f05a6e89 (table test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]) successfully deleted
I20260810 03:17:20.982340 14855 ts_tablet_manager.cc:1918] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:20.982484 14855 log.cc:1196] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/9da394d507dd49a781e2a208f05a6e89
I20260810 03:17:20.982896 14855 ts_tablet_manager.cc:1939] T 9da394d507dd49a781e2a208f05a6e89 P 045b2c95aa9a4f428c787a6e1f4f697c: Deleting consensus metadata
I20260810 03:17:20.984181 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:20.960130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34112 (local address 127.18.112.65:41275)
0810 03:17:20.960335 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:20.960340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:20.962571 (+ 2231us) server_negotiation.cc:407] Connection header received
0810 03:17:20.962839 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:20.962844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:20.962937 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:20.963012 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:20.964866 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.966158 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.968202 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:20.968913 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:20.969012 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:20.977205 (+ 8193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:20.977218 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:20.977233 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:20.977276 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:20.980566 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.981377 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.981385 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.981393 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.981576 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:20.981994 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:20.981999 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:20.982003 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:20.982411 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:20.982731 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:20.983307 (+ 576us) server_negotiation.cc:299] Negotiation successful
0810 03:17:20.983604 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 03:17:20.984432 14022 catalog_manager.cc:4841] TS 045b2c95aa9a4f428c787a6e1f4f697c (127.18.112.66:39643): tablet 9da394d507dd49a781e2a208f05a6e89 (table test-table [id=34c84b11c65c4b439c7ba5bffba39e6c]) successfully deleted
I20260810 03:17:20.984898 14328 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:21.092646 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 14143
I20260810 03:17:21.119818 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 14351
Aug 10 03:17:21 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:17:21.134130 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:21.120561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45376 (local address 127.18.112.66:39643)
0810 03:17:21.120738 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:21.120744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:21.120798 (+ 54us) server_negotiation.cc:407] Connection header received
0810 03:17:21.120947 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:21.120953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:21.121046 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:21.121160 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:21.122327 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.123415 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.124727 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.125346 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.125462 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:21.129321 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:21.129333 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:21.129347 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:21.129380 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:21.132053 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:21.132589 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:21.132595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:21.132598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:21.132714 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:21.132980 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:21.132983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:21.132985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:21.133348 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:21.133554 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:21.133749 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 03:17:21.133898 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:17:21.134740 14542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:21.220413 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 14351
I20260810 03:17:21.242980 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 14555
Aug 10 03:17:21 dist-test-slave-jlzn krb5kdc[13982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:17:21.257125 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:21.243678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57296 (local address 127.18.112.67:36133)
0810 03:17:21.243864 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:21.243869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:21.243887 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:17:21.244031 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:21.244035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:21.244101 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:21.244189 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:21.245428 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.246235 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.247590 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.248009 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.248098 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:21.252257 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:21.252271 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:21.252289 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:21.252325 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:21.254948 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:21.255500 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:21.255507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:21.255509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:21.255647 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:21.255964 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:21.255967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:21.255969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:21.256313 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:21.256512 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:21.256734 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 03:17:21.256894 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:17:21.257685 14763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:21.343139 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 14555
I20260810 03:17:21.366189 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 13998
I20260810 03:17:21.367180 14093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:21.471554 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 13998
2026-08-10T03:17:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4239 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T03:17:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:21Z Disabled control of system clock
I20260810 03:17:21.554092 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36753
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:36753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:21.869626 14866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:21.869890 14866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:21.869977 14866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:21.877152 14866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:21.877250 14866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:21.877295 14866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:21.877349 14866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:21.877393 14866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:21.886211 14866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:36753
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:21.887341 14866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:21.889017 14866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:21.899760 14881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:21.899824 14883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:21.899868 14880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:21.900936 14866 server_base.cc:1034] running on GCE node
I20260810 03:17:21.901643 14866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:21.902832 14866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:21.904016 14866 hybrid_clock.cc:648] HybridClock initialized: now 1786331841903979 us; error 33 us; skew 500 ppm
I20260810 03:17:21.904301 14866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:21.906304 14866 webserver.cc:460] Webserver started at http://127.18.112.126:36411/ using document root <none> and password file <none>
I20260810 03:17:21.907021 14866 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:21.907114 14866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:21.907369 14866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:21.910018 14866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "4ea47ef690d748ff901fa688c991927f"
format_stamp: "Formatted at 2026-08-10 03:17:21 on dist-test-slave-jlzn"
server_key: "e81043c0ea454fc1c7da7c84166ea840"
server_key_iv: "50a6a0c66df4b966a2a8e3d13b15830b"
server_key_version: "encryptionkey@0"
I20260810 03:17:21.910739 14866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "4ea47ef690d748ff901fa688c991927f"
format_stamp: "Formatted at 2026-08-10 03:17:21 on dist-test-slave-jlzn"
server_key: "e81043c0ea454fc1c7da7c84166ea840"
server_key_iv: "50a6a0c66df4b966a2a8e3d13b15830b"
server_key_version: "encryptionkey@0"
I20260810 03:17:21.915295 14866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 03:17:21.918433 14891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:21.919561 14866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:17:21.919703 14866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "4ea47ef690d748ff901fa688c991927f"
format_stamp: "Formatted at 2026-08-10 03:17:21 on dist-test-slave-jlzn"
server_key: "e81043c0ea454fc1c7da7c84166ea840"
server_key_iv: "50a6a0c66df4b966a2a8e3d13b15830b"
server_key_version: "encryptionkey@0"
I20260810 03:17:21.919905 14866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:21.955788 14866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:21.956478 14866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:21.956720 14866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:21.973289 14866 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:36753
I20260810 03:17:21.973323 14968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:36753 every 8 connection(s)
I20260810 03:17:21.974478 14866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:21.977890 14969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:21.984426 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 14866
I20260810 03:17:21.984581 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:21.985009 18881 external_mini_cluster.cc:1428] Setting key c23a69eac06f65ebedf056ae3c44826a
I20260810 03:17:21.987932 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: Bootstrap starting.
I20260810 03:17:21.991767 14969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:21.993041 14969 log.cc:824] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:21.995846 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: No bootstrap required, opened a new log
I20260810 03:17:21.999784 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:21.986672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.18.112.126:36753)
0810 03:17:21.987649 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:21.987663 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:21.987712 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:17:21.990058 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:21.990085 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:21.990623 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:21.991020 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:21.991520 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.993496 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.994959 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:21.995989 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:21.996183 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:21.997152 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:21.997163 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:21.997181 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:21.997907 (+ 726us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:21.998002 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:21.998038 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:21.998149 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:21.998299 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 03:17:21.998609 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":279,"threads_started":1}
I20260810 03:17:22.004000 14969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } }
I20260810 03:17:22.004295 14969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:22.004364 14969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea47ef690d748ff901fa688c991927f, State: Initialized, Role: FOLLOWER
I20260810 03:17:22.004841 14969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } }
I20260810 03:17:22.005046 14969 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:22.005141 14969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:22.005261 14969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:22.007190 14969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } }
I20260810 03:17:22.007635 14969 leader_election.cc:302] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ea47ef690d748ff901fa688c991927f; no voters:
I20260810 03:17:22.008131 14969 leader_election.cc:288] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:22.008249 14977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:22.008930 14977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [term 1 LEADER]: Becoming Leader. State: Replica: 4ea47ef690d748ff901fa688c991927f, State: Running, Role: LEADER
I20260810 03:17:22.009402 14977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } }
I20260810 03:17:22.009943 14969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:22.012276 14979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ea47ef690d748ff901fa688c991927f. Latest consensus state: current_term: 1 leader_uuid: "4ea47ef690d748ff901fa688c991927f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } } }
I20260810 03:17:22.012667 14979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:22.013063 14978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ea47ef690d748ff901fa688c991927f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ea47ef690d748ff901fa688c991927f" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36753 } } }
I20260810 03:17:22.013437 14978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:22.014854 14994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:22.019368 14994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:22.027601 14994 catalog_manager.cc:1347] Generated new cluster ID: 7f29a03697224452b376167dad34f7a6
I20260810 03:17:22.027709 14994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:22.034277 14994 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:22.036167 14994 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:22.047034 14994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: Generated new TSK 0
I20260810 03:17:22.047894 14994 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:22.058511 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--builtin_ntp_servers=127.18.112.84:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:22.379909 15011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:22.380158 15011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:22.380278 15011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:22.387148 15011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:22.387240 15011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:22.387387 15011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:22.395992 15011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:22.397153 15011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:22.398799 15011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:22.410835 15018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:22.410895 15016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:22.410944 15022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:22.411864 15011 server_base.cc:1034] running on GCE node
I20260810 03:17:22.412374 15011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:22.413230 15011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:22.414434 15011 hybrid_clock.cc:648] HybridClock initialized: now 1786331842414380 us; error 42 us; skew 500 ppm
I20260810 03:17:22.414767 15011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:22.416824 15011 webserver.cc:460] Webserver started at http://127.18.112.65:39165/ using document root <none> and password file <none>
I20260810 03:17:22.417428 15011 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:22.417531 15011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:22.417838 15011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:22.420495 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "6251449550af43a8af94837f0c706966"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "e50bb069c99569f5092985a7697ba420"
server_key_iv: "8680d03c474e0d53f094f5235a6e44c3"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.421249 15011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "6251449550af43a8af94837f0c706966"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "e50bb069c99569f5092985a7697ba420"
server_key_iv: "8680d03c474e0d53f094f5235a6e44c3"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.426052 15011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:22.429243 15034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.430374 15011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 03:17:22.430522 15011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "6251449550af43a8af94837f0c706966"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "e50bb069c99569f5092985a7697ba420"
server_key_iv: "8680d03c474e0d53f094f5235a6e44c3"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.430706 15011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:22.452235 15011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:22.452907 15011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:22.453176 15011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:22.454018 15011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:22.455365 15011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:22.455463 15011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.455569 15011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:22.455639 15011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.485097 15011 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:45249
I20260810 03:17:22.485172 15213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:45249 every 8 connection(s)
I20260810 03:17:22.486228 15011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:22.496076 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 15011
I20260810 03:17:22.496244 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:22.496685 18881 external_mini_cluster.cc:1428] Setting key cf219a43e3bf43df2303af8d43518e0a
I20260810 03:17:22.497426 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:22.488484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:60671 (local address 127.18.112.126:36753)
0810 03:17:22.488696 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:22.488703 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:22.489901 (+ 1198us) server_negotiation.cc:407] Connection header received
0810 03:17:22.491531 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:22.491535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:22.491602 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:22.491685 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:22.492626 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.493335 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.494865 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.495265 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.495355 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:22.496676 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:22.496681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:22.496684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:22.496701 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:22.496733 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:22.496745 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:22.496826 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:22.497069 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 03:17:22.497151 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:17:22.498383 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:22.488943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36753 (local address 127.18.112.65:60671)
0810 03:17:22.489765 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:22.489804 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:22.491308 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:22.491888 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:22.491895 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:22.491981 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:22.492481 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:22.492496 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.493463 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.493466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:22.494743 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:22.494756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.495421 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.495426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:22.495697 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:22.496388 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:22.496391 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:22.496426 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:22.496499 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:22.496869 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:22.496882 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:22.496889 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:22.497074 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 03:17:22.497387 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":249,"threads_started":1}
I20260810 03:17:22.499643 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--builtin_ntp_servers=127.18.112.84:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:22.499711 15214 heartbeater.cc:347] Connected to a master server at 127.18.112.126:36753
I20260810 03:17:22.500003 15214 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:22.500777 15214 heartbeater.cc:511] Master 127.18.112.126:36753 requested a full tablet report, sending...
I20260810 03:17:22.502717 14920 ts_manager.cc:194] Registered new tserver with Master: 6251449550af43a8af94837f0c706966 (127.18.112.65:45249)
I20260810 03:17:22.504200 14920 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.65:60671
W20260810 03:17:22.814481 15221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:22.814749 15221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:22.814884 15221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:22.821712 15221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:22.821806 15221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:22.821941 15221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:22.830466 15221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:22.831579 15221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:22.833204 15221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:22.845360 15228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:22.845479 15229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:22.845482 15231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:22.846489 15221 server_base.cc:1034] running on GCE node
I20260810 03:17:22.847059 15221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:22.847921 15221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:22.849125 15221 hybrid_clock.cc:648] HybridClock initialized: now 1786331842849071 us; error 45 us; skew 500 ppm
I20260810 03:17:22.849411 15221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:22.851377 15221 webserver.cc:460] Webserver started at http://127.18.112.66:33309/ using document root <none> and password file <none>
I20260810 03:17:22.852041 15221 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:22.852142 15221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:22.852418 15221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:22.855000 15221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "bdb9d1cbf1c44735910fd304e895fd8d"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "30f4d8f93e5ca8f507c0f251d44ac60a"
server_key_iv: "9435781acd63fb2707adddfd58c81647"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.855746 15221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "bdb9d1cbf1c44735910fd304e895fd8d"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "30f4d8f93e5ca8f507c0f251d44ac60a"
server_key_iv: "9435781acd63fb2707adddfd58c81647"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.860289 15221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:22.863395 15238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.864885 15221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:22.865064 15221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "bdb9d1cbf1c44735910fd304e895fd8d"
format_stamp: "Formatted at 2026-08-10 03:17:22 on dist-test-slave-jlzn"
server_key: "30f4d8f93e5ca8f507c0f251d44ac60a"
server_key_iv: "9435781acd63fb2707adddfd58c81647"
server_key_version: "encryptionkey@0"
I20260810 03:17:22.865283 15221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:22.890121 15221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:22.890774 15221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:22.891042 15221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:22.891924 15221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:22.893225 15221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:22.893321 15221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.893426 15221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:22.893497 15221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:22.921176 15221 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:36319
I20260810 03:17:22.921240 15413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:36319 every 8 connection(s)
I20260810 03:17:22.922283 15221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:22.926543 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 15221
I20260810 03:17:22.926736 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:22.927281 18881 external_mini_cluster.cc:1428] Setting key 1adef2d3147682df2dead87bfe60ec20
I20260810 03:17:22.930051 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--builtin_ntp_servers=127.18.112.84:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:22.934203 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:22.924594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:56211 (local address 127.18.112.126:36753)
0810 03:17:22.924760 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:22.924765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:22.925973 (+ 1208us) server_negotiation.cc:407] Connection header received
0810 03:17:22.928215 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:22.928221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:22.928295 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:22.928382 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:22.929429 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.930139 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.931671 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.932109 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.932219 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:22.933430 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:22.933435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:22.933438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:22.933454 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:22.933485 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:22.933496 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:22.933578 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:22.933777 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 03:17:22.933872 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:17:22.935101 15416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:22.925048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36753 (local address 127.18.112.66:56211)
0810 03:17:22.925851 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:22.925883 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:22.927959 (+ 2076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:22.928625 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:22.928633 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:22.928724 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:22.929259 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:22.929284 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.930333 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.930337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:22.931524 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:22.931537 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:22.932321 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:22.932329 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:22.932529 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:22.933132 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:22.933135 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:22.933186 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:22.933269 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:22.933588 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:22.933599 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:22.933607 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 03:17:22.933750 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 03:17:22.934103 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":236,"threads_started":1}
I20260810 03:17:22.936435 15414 heartbeater.cc:347] Connected to a master server at 127.18.112.126:36753
I20260810 03:17:22.936699 15414 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:22.937361 15414 heartbeater.cc:511] Master 127.18.112.126:36753 requested a full tablet report, sending...
I20260810 03:17:22.938688 14920 ts_manager.cc:194] Registered new tserver with Master: bdb9d1cbf1c44735910fd304e895fd8d (127.18.112.66:36319)
I20260810 03:17:22.939628 14920 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.66:56211
W20260810 03:17:23.245575 15417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:23.245824 15417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:23.245915 15417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:23.252701 15417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:23.252782 15417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:23.252884 15417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:23.261246 15417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:36753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:23.262239 15417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:23.263841 15417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:23.275616 15425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:23.275660 15426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:23.275687 15430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:23.276584 15417 server_base.cc:1034] running on GCE node
I20260810 03:17:23.277129 15417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:23.277940 15417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:23.279134 15417 hybrid_clock.cc:648] HybridClock initialized: now 1786331843279079 us; error 42 us; skew 500 ppm
I20260810 03:17:23.279404 15417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:23.281389 15417 webserver.cc:460] Webserver started at http://127.18.112.67:41399/ using document root <none> and password file <none>
I20260810 03:17:23.281996 15417 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:23.282099 15417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:23.282378 15417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:23.284982 15417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "11b3467dd5fc403e8502add838947713"
format_stamp: "Formatted at 2026-08-10 03:17:23 on dist-test-slave-jlzn"
server_key: "56623628a2c7a69a0fb1197267cb27d6"
server_key_iv: "a1e8bcd15c1de233daffed76fa49a036"
server_key_version: "encryptionkey@0"
I20260810 03:17:23.285732 15417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "11b3467dd5fc403e8502add838947713"
format_stamp: "Formatted at 2026-08-10 03:17:23 on dist-test-slave-jlzn"
server_key: "56623628a2c7a69a0fb1197267cb27d6"
server_key_iv: "a1e8bcd15c1de233daffed76fa49a036"
server_key_version: "encryptionkey@0"
I20260810 03:17:23.290270 15417 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:17:23.293381 15436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:23.294466 15417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:17:23.294613 15417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "11b3467dd5fc403e8502add838947713"
format_stamp: "Formatted at 2026-08-10 03:17:23 on dist-test-slave-jlzn"
server_key: "56623628a2c7a69a0fb1197267cb27d6"
server_key_iv: "a1e8bcd15c1de233daffed76fa49a036"
server_key_version: "encryptionkey@0"
I20260810 03:17:23.294813 15417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:23.321775 15417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:23.322461 15417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:23.322724 15417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:23.323604 15417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:23.324978 15417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:23.325066 15417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:23.325167 15417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:23.325241 15417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:23.353711 15417 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:41257
I20260810 03:17:23.353782 15628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:41257 every 8 connection(s)
I20260810 03:17:23.354854 15417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:23.357684 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 15417
I20260810 03:17:23.357843 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:23.358258 18881 external_mini_cluster.cc:1428] Setting key 7c481c0288ed8cb0259b33584de10dfc
I20260810 03:17:23.365994 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.357067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:41947 (local address 127.18.112.126:36753)
0810 03:17:23.357228 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.357232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.358623 (+ 1391us) server_negotiation.cc:407] Connection header received
0810 03:17:23.360517 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.360522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.360603 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.360707 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:23.361712 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.362398 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.363832 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.364241 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.364335 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.365427 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:23.365432 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:23.365435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:23.365451 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:23.365482 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:23.365493 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:23.365558 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.365711 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.365780 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:17:23.366854 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.357465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36753 (local address 127.18.112.67:41947)
0810 03:17:23.358453 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.358505 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.360283 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.360924 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.360934 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.361042 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:23.361567 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.361582 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.362518 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.362521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.363687 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.363698 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.364418 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.364423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.364610 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.365167 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:23.365169 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:23.365203 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:23.365277 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:23.365563 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:23.365569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:23.365574 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.365695 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.365943 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":313,"threads_started":1}
I20260810 03:17:23.367991 15629 heartbeater.cc:347] Connected to a master server at 127.18.112.126:36753
I20260810 03:17:23.368243 15629 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:23.368866 15629 heartbeater.cc:511] Master 127.18.112.126:36753 requested a full tablet report, sending...
I20260810 03:17:23.370105 14920 ts_manager.cc:194] Registered new tserver with Master: 11b3467dd5fc403e8502add838947713 (127.18.112.67:41257)
I20260810 03:17:23.370857 14920 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.67:41947
I20260810 03:17:23.372978 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:23.382072 14973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.376894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57078 (local address 127.18.112.126:36753)
0810 03:17:23.377038 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.377042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.377554 (+ 512us) server_negotiation.cc:407] Connection header received
0810 03:17:23.377672 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.377675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.377762 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.377837 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:23.378240 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.378919 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.380191 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.380557 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.380655 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.381542 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:23.381547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:23.381550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:23.381565 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:23.381591 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:23.381601 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:23.381702 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.381814 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.381850 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:17:23.385247 14920 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:23.392096 14920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:23.412158 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.402489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54708)
0810 03:17:23.403168 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.403200 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.403356 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.404368 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.404376 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.404408 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:23.404834 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.404847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.406639 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.406645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.408982 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.409002 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.411059 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.411065 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.411282 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.411474 (+ 192us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.411607 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.411788 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":110,"thread_start_us":262,"threads_started":1}
I20260810 03:17:23.413085 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.402752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54708 (local address 127.18.112.65:45249)
0810 03:17:23.403256 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.403265 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.403295 (+ 30us) server_negotiation.cc:407] Connection header received
0810 03:17:23.403623 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.403633 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.403904 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.404086 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:23.405043 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.406473 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.409190 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.410561 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.410699 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.410930 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.412616 (+ 1686us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.412787 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":430,"threads_started":1}
I20260810 03:17:23.415910 15647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.403461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:41257 (local address 127.0.0.1:44946)
0810 03:17:23.405057 (+ 1596us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.405074 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.405275 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.406088 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.406092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.406117 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:23.407990 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.408004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.409812 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.409817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.413235 (+ 3418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.413251 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.415178 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.415185 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.415369 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.415403 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.415483 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.415600 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1478,"thread_start_us":1364,"threads_started":1}
I20260810 03:17:23.416128 15648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.403743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44946 (local address 127.18.112.67:41257)
0810 03:17:23.404698 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.404703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.405172 (+ 469us) server_negotiation.cc:407] Connection header received
0810 03:17:23.405456 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.405463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.405653 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.405798 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:23.408204 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.409643 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.413385 (+ 3742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.414691 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.414811 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.415048 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.415563 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.415767 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":686,"threads_started":1}
I20260810 03:17:23.417634 15113 tablet_service.cc:1467] Processing CreateTablet for tablet db374b0c64704c59a23e72729c8a0822 (DEFAULT_TABLE table=test-table [id=8757b5f5290448f9b348db8a9207eb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:23.419080 15113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db374b0c64704c59a23e72729c8a0822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:23.418808 15519 tablet_service.cc:1467] Processing CreateTablet for tablet db374b0c64704c59a23e72729c8a0822 (DEFAULT_TABLE table=test-table [id=8757b5f5290448f9b348db8a9207eb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:23.420104 15519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db374b0c64704c59a23e72729c8a0822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:23.421257 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.405130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:36319 (local address 127.0.0.1:43644)
0810 03:17:23.412367 (+ 7237us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.412382 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.412467 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.414283 (+ 1816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.414287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.414313 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:23.414446 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.414456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.416554 (+ 2098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.416559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.418228 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.418243 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.420584 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.420590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.420799 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.420829 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.420907 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.421025 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7152,"thread_start_us":8707,"threads_started":1}
I20260810 03:17:23.422266 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.405419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43644 (local address 127.18.112.66:36319)
0810 03:17:23.413773 (+ 8354us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.413780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.413808 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:17:23.413894 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.413901 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.414103 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.414292 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:23.414884 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.416386 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.418410 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.420250 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.420370 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.421720 (+ 1350us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.421784 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.421935 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8196,"thread_start_us":8103,"threads_started":1}
I20260810 03:17:23.427053 15324 tablet_service.cc:1467] Processing CreateTablet for tablet db374b0c64704c59a23e72729c8a0822 (DEFAULT_TABLE table=test-table [id=8757b5f5290448f9b348db8a9207eb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:23.428386 15324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db374b0c64704c59a23e72729c8a0822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:23.430721 15653 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Bootstrap starting.
I20260810 03:17:23.433959 15653 tablet_bootstrap.cc:654] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:23.434922 15653 log.cc:824] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:23.436226 15654 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Bootstrap starting.
I20260810 03:17:23.437824 15653 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: No bootstrap required, opened a new log
I20260810 03:17:23.438046 15653 ts_tablet_manager.cc:1397] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 03:17:23.440588 15657 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Bootstrap starting.
I20260810 03:17:23.443197 15657 tablet_bootstrap.cc:654] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:23.443647 15654 tablet_bootstrap.cc:654] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:23.444123 15657 log.cc:824] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:23.444761 15654 log.cc:824] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:23.446591 15657 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: No bootstrap required, opened a new log
I20260810 03:17:23.446810 15657 ts_tablet_manager.cc:1397] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 03:17:23.447562 15654 tablet_bootstrap.cc:492] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: No bootstrap required, opened a new log
I20260810 03:17:23.447430 15653 raft_consensus.cc:348] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.447944 15654 ts_tablet_manager.cc:1397] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.005s
I20260810 03:17:23.447986 15653 raft_consensus.cc:374] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:23.448196 15653 raft_consensus.cc:729] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b3467dd5fc403e8502add838947713, State: Initialized, Role: FOLLOWER
I20260810 03:17:23.448787 15653 consensus_queue.cc:260] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.449823 15629 heartbeater.cc:503] Master 127.18.112.126:36753 was elected leader, sending a full tablet report...
I20260810 03:17:23.450415 15653 ts_tablet_manager.cc:1428] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260810 03:17:23.456249 15657 raft_consensus.cc:348] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.456542 15657 raft_consensus.cc:374] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:23.456636 15657 raft_consensus.cc:729] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb9d1cbf1c44735910fd304e895fd8d, State: Initialized, Role: FOLLOWER
I20260810 03:17:23.456490 15654 raft_consensus.cc:348] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.456853 15654 raft_consensus.cc:374] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:23.456959 15654 raft_consensus.cc:729] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6251449550af43a8af94837f0c706966, State: Initialized, Role: FOLLOWER
I20260810 03:17:23.457175 15657 consensus_queue.cc:260] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.457446 15654 consensus_queue.cc:260] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.458091 15414 heartbeater.cc:503] Master 127.18.112.126:36753 was elected leader, sending a full tablet report...
I20260810 03:17:23.458696 15657 ts_tablet_manager.cc:1428] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260810 03:17:23.458731 15654 ts_tablet_manager.cc:1428] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260810 03:17:23.459045 15214 heartbeater.cc:503] Master 127.18.112.126:36753 was elected leader, sending a full tablet report...
I20260810 03:17:23.475459 15665 raft_consensus.cc:482] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:23.475718 15665 raft_consensus.cc:504] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.477177 15665 leader_election.cc:288] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6251449550af43a8af94837f0c706966 (127.18.112.65:45249), 11b3467dd5fc403e8502add838947713 (127.18.112.67:41257)
I20260810 03:17:23.483945 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.477568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:56271 (local address 127.18.112.65:45249)
0810 03:17:23.477775 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.477782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.478092 (+ 310us) server_negotiation.cc:407] Connection header received
0810 03:17:23.478262 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.478267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.478349 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.478441 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:23.479038 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.479991 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.482169 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.483078 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.483193 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.483238 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.483593 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.483682 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:17:23.484061 15672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.477471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.18.112.66:56271)
0810 03:17:23.477997 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.478012 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.478144 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.478489 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.478499 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.478531 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:23.478908 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.478917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.480108 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.480114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.481975 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.481990 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.483255 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.483261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.483443 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.483479 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.483571 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.483697 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":2,"thread_start_us":272,"threads_started":1}
I20260810 03:17:23.484558 15648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.478198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:50463 (local address 127.18.112.67:41257)
0810 03:17:23.478380 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.478386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.478890 (+ 504us) server_negotiation.cc:407] Connection header received
0810 03:17:23.479069 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.479075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.479135 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.479198 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:23.479725 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.480659 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.482721 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.483657 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.483794 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.483883 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.484232 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.484349 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:17:23.485157 15673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.478102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:41257 (local address 127.18.112.66:50463)
0810 03:17:23.478798 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.478811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:23.478933 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:23.479231 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:23.479236 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:23.479261 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:23.479601 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.479611 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.480798 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.480802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.482547 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:23.482561 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.483856 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.483863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:23.484038 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.484074 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:17:23.484718 (+ 644us) client_negotiation.cc:240] Negotiation successful
0810 03:17:23.484836 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":46,"thread_start_us":405,"threads_started":1}
I20260810 03:17:23.484987 15142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db374b0c64704c59a23e72729c8a0822" candidate_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6251449550af43a8af94837f0c706966" is_pre_election: true
I20260810 03:17:23.485461 15142 raft_consensus.cc:2454] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb9d1cbf1c44735910fd304e895fd8d in term 0.
I20260810 03:17:23.486076 15239 leader_election.cc:302] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6251449550af43a8af94837f0c706966, bdb9d1cbf1c44735910fd304e895fd8d; no voters:
I20260810 03:17:23.486151 15550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db374b0c64704c59a23e72729c8a0822" candidate_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b3467dd5fc403e8502add838947713" is_pre_election: true
I20260810 03:17:23.486508 15665 raft_consensus.cc:2781] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:23.486649 15665 raft_consensus.cc:482] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:23.486600 15550 raft_consensus.cc:2454] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb9d1cbf1c44735910fd304e895fd8d in term 0.
I20260810 03:17:23.486748 15665 raft_consensus.cc:3037] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 0 FOLLOWER]: Advancing to term 1
W20260810 03:17:23.488125 15216 tablet.cc:2369] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:23.489678 15665 raft_consensus.cc:504] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.490255 15665 leader_election.cc:288] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [CANDIDATE]: Term 1 election: Requested vote from peers 6251449550af43a8af94837f0c706966 (127.18.112.65:45249), 11b3467dd5fc403e8502add838947713 (127.18.112.67:41257)
I20260810 03:17:23.490628 15142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db374b0c64704c59a23e72729c8a0822" candidate_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6251449550af43a8af94837f0c706966"
I20260810 03:17:23.490702 15550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db374b0c64704c59a23e72729c8a0822" candidate_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b3467dd5fc403e8502add838947713"
I20260810 03:17:23.490806 15142 raft_consensus.cc:3037] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:23.490870 15550 raft_consensus.cc:3037] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:23.492986 15550 raft_consensus.cc:2454] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb9d1cbf1c44735910fd304e895fd8d in term 1.
I20260810 03:17:23.493316 15239 leader_election.cc:302] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b3467dd5fc403e8502add838947713, bdb9d1cbf1c44735910fd304e895fd8d; no voters:
I20260810 03:17:23.493546 15665 raft_consensus.cc:2781] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:23.493877 15142 raft_consensus.cc:2454] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb9d1cbf1c44735910fd304e895fd8d in term 1.
I20260810 03:17:23.493968 15665 raft_consensus.cc:686] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 1 LEADER]: Becoming Leader. State: Replica: bdb9d1cbf1c44735910fd304e895fd8d, State: Running, Role: LEADER
I20260810 03:17:23.494457 15665 consensus_queue.cc:237] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } }
I20260810 03:17:23.498337 14917 catalog_manager.cc:5495] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb9d1cbf1c44735910fd304e895fd8d (127.18.112.66). New cstate: current_term: 1 leader_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb9d1cbf1c44735910fd304e895fd8d" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 36319 } health_report { overall_health: HEALTHY } } }
I20260810 03:17:23.535832 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.530689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43650 (local address 127.18.112.66:36319)
0810 03:17:23.530882 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.530888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.530951 (+ 63us) server_negotiation.cc:407] Connection header received
0810 03:17:23.531096 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.531100 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.531178 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.531291 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:23.531607 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.532337 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.533639 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.534089 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.534204 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.534760 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:23.535255 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:23.535408 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.535569 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.535608 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:17:23.542793 15550 raft_consensus.cc:1261] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 1 FOLLOWER]: Refusing update from remote peer bdb9d1cbf1c44735910fd304e895fd8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:23.542804 15142 raft_consensus.cc:1261] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 1 FOLLOWER]: Refusing update from remote peer bdb9d1cbf1c44735910fd304e895fd8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:23.543607 15676 consensus_queue.cc:1035] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6251449550af43a8af94837f0c706966" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 45249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:23.543923 15665 consensus_queue.cc:1035] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b3467dd5fc403e8502add838947713" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:23.565640 14920 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:23.565869 14920 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:23.569121 14920 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ea47ef690d748ff901fa688c991927f: Sending DeleteTablet for 3 replicas of tablet db374b0c64704c59a23e72729c8a0822
I20260810 03:17:23.570294 15113 tablet_service.cc:1514] Processing DeleteTablet for tablet db374b0c64704c59a23e72729c8a0822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:23 UTC) from {username='slave'} at 127.0.0.1:54708
I20260810 03:17:23.570294 15519 tablet_service.cc:1514] Processing DeleteTablet for tablet db374b0c64704c59a23e72729c8a0822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:23 UTC) from {username='slave'} at 127.0.0.1:44946
I20260810 03:17:23.570374 15324 tablet_service.cc:1514] Processing DeleteTablet for tablet db374b0c64704c59a23e72729c8a0822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:23 UTC) from {username='slave'} at 127.0.0.1:43644
I20260810 03:17:23.572435 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 15011
I20260810 03:17:23.586248 15696 tablet_replica.cc:330] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: stopping tablet replica
I20260810 03:17:23.586788 15696 raft_consensus.cc:2229] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:23.587359 15696 raft_consensus.cc:2258] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:23.589885 15698 tablet_replica.cc:330] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: stopping tablet replica
I20260810 03:17:23.590973 15696 ts_tablet_manager.cc:1905] T db374b0c64704c59a23e72729c8a0822 P 6251449550af43a8af94837f0c706966: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:23.592489 15698 raft_consensus.cc:2229] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:23.592998 15698 raft_consensus.cc:2258] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:23.593770 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.573701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.18.112.65:45249)
0810 03:17:23.573868 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.573874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.580129 (+ 6255us) server_negotiation.cc:407] Connection header received
0810 03:17:23.580962 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.580968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.581087 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.581161 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:23.582222 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.583453 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.587788 (+ 4335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.588489 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.588594 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.592222 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:23.592233 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:23.592248 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:23.592909 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:23.592967 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:23.593006 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:23.593120 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.593338 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.593446 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:17:23.594206 15700 tablet_replica.cc:330] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: stopping tablet replica
I20260810 03:17:23.594635 15700 raft_consensus.cc:2229] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:23.594761 15205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:23.595284 15700 raft_consensus.cc:2258] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:23.596791 15700 ts_tablet_manager.cc:1905] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:23.600359 15698 ts_tablet_manager.cc:1905] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:23.601948 15700 ts_tablet_manager.cc:1918] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:23.602093 15700 log.cc:1196] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/db374b0c64704c59a23e72729c8a0822
I20260810 03:17:23.602675 15700 ts_tablet_manager.cc:1939] T db374b0c64704c59a23e72729c8a0822 P bdb9d1cbf1c44735910fd304e895fd8d: Deleting consensus metadata
I20260810 03:17:23.604622 14893 catalog_manager.cc:4841] TS bdb9d1cbf1c44735910fd304e895fd8d (127.18.112.66:36319): tablet db374b0c64704c59a23e72729c8a0822 (table test-table [id=8757b5f5290448f9b348db8a9207eb56]) successfully deleted
I20260810 03:17:23.608234 15698 ts_tablet_manager.cc:1918] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:23.608392 15698 log.cc:1196] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/db374b0c64704c59a23e72729c8a0822
I20260810 03:17:23.608893 15698 ts_tablet_manager.cc:1939] T db374b0c64704c59a23e72729c8a0822 P 11b3467dd5fc403e8502add838947713: Deleting consensus metadata
I20260810 03:17:23.610556 14893 catalog_manager.cc:4841] TS 11b3467dd5fc403e8502add838947713 (127.18.112.67:41257): tablet db374b0c64704c59a23e72729c8a0822 (table test-table [id=8757b5f5290448f9b348db8a9207eb56]) successfully deleted
I20260810 03:17:23.688443 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 15011
W20260810 03:17:23.719578 14893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.112.65:45249 (error 108)
I20260810 03:17:23.720389 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 15221
I20260810 03:17:23.721781 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.721147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54734)
0810 03:17:23.721455 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.721588 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
W20260810 03:17:23.722061 14893 catalog_manager.cc:4584] TS 6251449550af43a8af94837f0c706966 (127.18.112.65:45249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db374b0c64704c59a23e72729c8a0822: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
I20260810 03:17:23.727705 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.721337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43652 (local address 127.18.112.66:36319)
0810 03:17:23.721545 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.721552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.721573 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:17:23.721710 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.721715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.721816 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.721934 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:23.722500 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.723349 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.724771 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.725202 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.725315 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.726367 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:23.726376 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:23.726390 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:23.726976 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:23.727032 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:23.727053 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:23.727156 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.727302 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.727400 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:17:23.728458 15408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:23.775661 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.775127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54738)
0810 03:17:23.775381 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.775490 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260810 03:17:23.776723 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.776318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54744)
0810 03:17:23.776460 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.776546 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 03:17:23.836501 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 15221
I20260810 03:17:23.842219 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.841757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54758)
0810 03:17:23.841982 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.842071 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 03:17:23.843225 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.842893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54772)
0810 03:17:23.843013 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.843081 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 03:17:23.860605 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 15417
I20260810 03:17:23.867122 15648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.861282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44956 (local address 127.18.112.67:41257)
0810 03:17:23.861450 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:23.861456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:23.861476 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:17:23.861664 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:23.861669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:23.861748 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:23.861859 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:23.862256 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.862972 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.864365 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:23.864759 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:23.864872 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:23.865818 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:23.865827 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:23.865841 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:23.866411 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:23.866459 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:23.866480 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:23.866584 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:23.866719 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 03:17:23.866826 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:17:23.867779 15622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:23.923467 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.922983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54778)
0810 03:17:23.923174 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.923307 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:17:23.924544 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:23.924108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:45249 (local address 127.0.0.1:54790)
0810 03:17:23.924311 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:23.924406 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:45249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260810 03:17:23.953222 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 15417
I20260810 03:17:23.972958 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 14866
I20260810 03:17:23.973954 14964 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:24.078675 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 14866
2026-08-10T03:17:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2607 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:24 dist-test-slave-jlzn krb5kdc[15715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:24 dist-test-slave-jlzn krb5kdc[15715](info): set up 2 sockets
Aug 10 03:17:24 dist-test-slave-jlzn krb5kdc[15715](info): commencing operation
krb5kdc: starting...
W20260810 03:17:25.271369 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:25 dist-test-slave-jlzn krb5kdc[15715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:17:25.510701 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40443
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:40443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:25.828989 15737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:25.829250 15737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:25.829344 15737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:25.836205 15737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:25.836295 15737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:25.836346 15737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:25.836401 15737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:25.836442 15737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:25.845631 15737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:40443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:40443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:25.846694 15737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:25.847885 15737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:25.858700 15748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:25.858741 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:25.858780 15743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:25.859418 15737 server_base.cc:1034] running on GCE node
I20260810 03:17:25.860167 15737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:25.861330 15737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:25.862560 15737 hybrid_clock.cc:648] HybridClock initialized: now 1786331845862484 us; error 27 us; skew 500 ppm
I20260810 03:17:25.862870 15737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:25 dist-test-slave-jlzn krb5kdc[15715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:25.869083 15737 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:17:25.870501 15737 webserver.cc:460] Webserver started at http://127.18.112.126:35999/ using document root <none> and password file <none>
I20260810 03:17:25.871101 15737 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:25.871220 15737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:25.871518 15737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:25.874413 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "cb4629ce5534477c80458d097f0c8c28"
format_stamp: "Formatted at 2026-08-10 03:17:25 on dist-test-slave-jlzn"
server_key: "77c193ecedb41f1e30d0b99e31b4656f"
server_key_iv: "9092a6e2365abf43497725c0dbfb0914"
server_key_version: "encryptionkey@0"
I20260810 03:17:25.875125 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "cb4629ce5534477c80458d097f0c8c28"
format_stamp: "Formatted at 2026-08-10 03:17:25 on dist-test-slave-jlzn"
server_key: "77c193ecedb41f1e30d0b99e31b4656f"
server_key_iv: "9092a6e2365abf43497725c0dbfb0914"
server_key_version: "encryptionkey@0"
I20260810 03:17:25.879876 15737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260810 03:17:25.883008 15764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:25.884228 15737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:25.884374 15737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "cb4629ce5534477c80458d097f0c8c28"
format_stamp: "Formatted at 2026-08-10 03:17:25 on dist-test-slave-jlzn"
server_key: "77c193ecedb41f1e30d0b99e31b4656f"
server_key_iv: "9092a6e2365abf43497725c0dbfb0914"
server_key_version: "encryptionkey@0"
I20260810 03:17:25.884537 15737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:25.901356 15737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:25.905151 15737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:25.905387 15737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:25.922176 15737 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:40443
I20260810 03:17:25.922195 15841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:40443 every 8 connection(s)
I20260810 03:17:25.923349 15737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:25.926694 15842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:25.931095 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 15737
I20260810 03:17:25.931272 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:25.931856 18881 external_mini_cluster.cc:1428] Setting key 5debb9c6c79e35341afa93b41b9e4f45
I20260810 03:17:25.937655 15842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: Bootstrap starting.
I20260810 03:17:25.940989 15842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:25.942194 15842 log.cc:824] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:25.945245 15842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: No bootstrap required, opened a new log
Aug 10 03:17:25 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:25.953723 15842 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } }
I20260810 03:17:25.953979 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:25.933506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.18.112.126:40443)
0810 03:17:25.934206 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:25.934216 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:25.934259 (+ 43us) server_negotiation.cc:407] Connection header received
0810 03:17:25.936278 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:25.936299 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:25.936618 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:25.936910 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:25.938638 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:25.939945 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:25.941699 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:25.942378 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:25.942504 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:25.947210 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:25.947217 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:25.947233 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:25.947270 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:25.950181 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:25.950995 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:25.951001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:25.951006 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:25.951179 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:25.951564 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:25.951570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:25.951572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:25.952111 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:25.952349 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:25.952766 (+ 417us) server_negotiation.cc:299] Negotiation successful
0810 03:17:25.953060 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":308,"threads_started":1}
I20260810 03:17:25.954077 15842 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:25.954196 15842 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4629ce5534477c80458d097f0c8c28, State: Initialized, Role: FOLLOWER
I20260810 03:17:25.954711 15842 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } }
I20260810 03:17:25.954924 15842 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:25.955113 15842 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:25.955323 15842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:25.957774 15842 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } }
I20260810 03:17:25.958180 15842 leader_election.cc:302] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4629ce5534477c80458d097f0c8c28; no voters:
I20260810 03:17:25.958655 15842 leader_election.cc:288] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:25.958770 15850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:25.960203 15850 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [term 1 LEADER]: Becoming Leader. State: Replica: cb4629ce5534477c80458d097f0c8c28, State: Running, Role: LEADER
I20260810 03:17:25.960593 15842 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:25.960644 15850 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } }
I20260810 03:17:25.963292 15852 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb4629ce5534477c80458d097f0c8c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } } }
I20260810 03:17:25.963325 15855 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4629ce5534477c80458d097f0c8c28. Latest consensus state: current_term: 1 leader_uuid: "cb4629ce5534477c80458d097f0c8c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4629ce5534477c80458d097f0c8c28" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 40443 } } }
I20260810 03:17:25.963667 15852 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:25.963670 15855 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28 [sys.catalog]: This master's current role is: LEADER
W20260810 03:17:25.974622 15871 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:17:25.974740 15871 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:17:25.974855 15860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:25.976987 15860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:25.984720 15860 catalog_manager.cc:1347] Generated new cluster ID: a0221ff5b92848c2bab09f04d61961ed
I20260810 03:17:25.984815 15860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:25.998992 15860 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:26.000483 15860 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:26.020238 15860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: Generated new TSK 0
I20260810 03:17:26.020954 15860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.112.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
Entry for principal kudu/127.18.112.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab.
I20260810 03:17:26.084496 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:26.400187 15879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:26.400441 15879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:26.400573 15879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:26.407310 15879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:26.407416 15879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:26.407591 15879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:26.416620 15879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.65.keytab
--principal=kudu/127.18.112.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:26.417676 15879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:26.418855 15879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:26.430837 15898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:26.430837 15891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:26.431262 15879 server_base.cc:1034] running on GCE node
W20260810 03:17:26.431470 15890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:26.432145 15879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:26.432979 15879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:26.434170 15879 hybrid_clock.cc:648] HybridClock initialized: now 1786331846434126 us; error 35 us; skew 500 ppm
I20260810 03:17:26.434441 15879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:26 dist-test-slave-jlzn krb5kdc[15715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331846, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:26.437361 15879 init.cc:377] Logged in from keytab as kudu/127.18.112.65@KRBTEST.COM (short username kudu)
I20260810 03:17:26.438611 15879 webserver.cc:460] Webserver started at http://127.18.112.65:43497/ using document root <none> and password file <none>
I20260810 03:17:26.439204 15879 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:26.439316 15879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:26.439596 15879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:26.442296 15879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "08b964f54c1947e98be6bdb65cea68ce"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "e7e285b7b52bea6b3c7b3c11eb623fc3"
server_key_iv: "fca9be330e632502588dc76f6900d3b4"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.443011 15879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "08b964f54c1947e98be6bdb65cea68ce"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "e7e285b7b52bea6b3c7b3c11eb623fc3"
server_key_iv: "fca9be330e632502588dc76f6900d3b4"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.447919 15879 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260810 03:17:26.451130 15915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:26.452407 15879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:26.452543 15879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "08b964f54c1947e98be6bdb65cea68ce"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "e7e285b7b52bea6b3c7b3c11eb623fc3"
server_key_iv: "fca9be330e632502588dc76f6900d3b4"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.452723 15879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:26.482301 15879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:26.486359 15879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:26.486604 15879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:26.487468 15879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:26.488799 15879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:26.488873 15879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:26.488968 15879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:26.489024 15879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:26.517032 15879 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:40281
I20260810 03:17:26.517093 16091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:40281 every 8 connection(s)
I20260810 03:17:26.518229 15879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:26.528343 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 15879
I20260810 03:17:26.528515 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:26.528972 18881 external_mini_cluster.cc:1428] Setting key cdc8af9d9f01c0411651163bc14815e9
Aug 10 03:17:26 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331846, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.65@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:26.536458 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:26.520659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:39009 (local address 127.18.112.126:40443)
0810 03:17:26.521030 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:26.521034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:26.522145 (+ 1111us) server_negotiation.cc:407] Connection header received
0810 03:17:26.523743 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:26.523747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:26.523834 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:26.523936 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:26.525225 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:26.525926 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:26.527351 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:26.527721 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:26.527830 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:26.531166 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:26.531171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:26.531174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:26.531205 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:26.533592 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:26.534239 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:26.534244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:26.534246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:26.534369 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:26.534792 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:26.534796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:26.534798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:26.535074 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:26.535209 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:26.535866 (+ 657us) server_negotiation.cc:299] Negotiation successful
0810 03:17:26.536110 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":191,"threads_started":1}
I20260810 03:17:26.537249 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:26.521201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40443 (local address 127.18.112.65:39009)
0810 03:17:26.521838 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:26.521880 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:26.523517 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:26.524116 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:26.524124 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:26.524581 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:26.525088 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:26.525105 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:26.526039 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:26.526042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:26.527242 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:26.527254 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:26.527906 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:26.527912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:26.528126 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:26.528749 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:26.528770 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:26.530964 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:26.533728 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:26.533737 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:26.533751 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:26.534127 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:26.534472 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:26.534477 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:26.534481 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:26.534671 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:26.535207 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:26.535214 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:26.535497 (+ 283us) client_negotiation.cc:769] Sending connection context
0810 03:17:26.535727 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 03:17:26.536216 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":256,"threads_started":1}
I20260810 03:17:26.538663 16092 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40443
I20260810 03:17:26.538914 16092 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:26.539544 16092 heartbeater.cc:511] Master 127.18.112.126:40443 requested a full tablet report, sending...
I20260810 03:17:26.541726 15792 ts_manager.cc:194] Registered new tserver with Master: 08b964f54c1947e98be6bdb65cea68ce (127.18.112.65:40281)
I20260810 03:17:26.543414 15792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.65@KRBTEST.COM'} at 127.18.112.65:39009
WARNING: no policy specified for kudu/127.18.112.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
Entry for principal kudu/127.18.112.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab.
I20260810 03:17:26.588169 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:26.897902 16100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:26.898170 16100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:26.898294 16100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:26.905215 16100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:26.905328 16100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:26.905473 16100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:26.914455 16100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.66.keytab
--principal=kudu/127.18.112.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:26.915518 16100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:26.916754 16100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:26.929323 16109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:26.929298 16111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:26.929901 16108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:26.930320 16100 server_base.cc:1034] running on GCE node
I20260810 03:17:26.930943 16100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:26.931953 16100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:26.933187 16100 hybrid_clock.cc:648] HybridClock initialized: now 1786331846933103 us; error 73 us; skew 500 ppm
I20260810 03:17:26.933509 16100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:26 dist-test-slave-jlzn krb5kdc[15715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331846, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:26.937161 16100 init.cc:377] Logged in from keytab as kudu/127.18.112.66@KRBTEST.COM (short username kudu)
I20260810 03:17:26.938659 16100 webserver.cc:460] Webserver started at http://127.18.112.66:44367/ using document root <none> and password file <none>
I20260810 03:17:26.939404 16100 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:26.939546 16100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:26.939889 16100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:26.942472 16100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "5e467d0aa59443adacff9e7c4132aef9"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "32a72dfa9e52db283a1d9a39a99201c2"
server_key_iv: "c4ec1382b3d439c8a4624195a0c4a7ae"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.943150 16100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "5e467d0aa59443adacff9e7c4132aef9"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "32a72dfa9e52db283a1d9a39a99201c2"
server_key_iv: "c4ec1382b3d439c8a4624195a0c4a7ae"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.948292 16100 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260810 03:17:26.951412 16122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:26.952682 16100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:26.952817 16100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "5e467d0aa59443adacff9e7c4132aef9"
format_stamp: "Formatted at 2026-08-10 03:17:26 on dist-test-slave-jlzn"
server_key: "32a72dfa9e52db283a1d9a39a99201c2"
server_key_iv: "c4ec1382b3d439c8a4624195a0c4a7ae"
server_key_version: "encryptionkey@0"
I20260810 03:17:26.952980 16100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:26.982983 16100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:26.986398 16100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:26.986625 16100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:26.987460 16100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:26.988727 16100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:26.988801 16100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:26.988911 16100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:26.988976 16100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:27.018334 16100 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:44659
I20260810 03:17:27.018393 16297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:44659 every 8 connection(s)
I20260810 03:17:27.019487 16100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:27.028167 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 16100
I20260810 03:17:27.028342 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:27.028864 18881 external_mini_cluster.cc:1428] Setting key 188d07d0b478f1021037b01383b82be8
Aug 10 03:17:27 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331846, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.66@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:27.039705 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.021725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:57917 (local address 127.18.112.126:40443)
0810 03:17:27.021886 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.021890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.022995 (+ 1105us) server_negotiation.cc:407] Connection header received
0810 03:17:27.024825 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.024830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.024906 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.024992 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:27.026419 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.027113 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.029072 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.029500 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.029637 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.033334 (+ 3697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:27.033339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:27.033343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:27.033374 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:27.035879 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.036924 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.036928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.036930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.037146 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.037677 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.037682 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.037685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.038062 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:27.038212 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.039102 (+ 890us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.039367 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:17:27.040534 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.022172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40443 (local address 127.18.112.66:57917)
0810 03:17:27.022846 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.022889 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.024573 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.025228 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.025236 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.025707 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:27.026258 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.026277 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.027261 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.027264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.028869 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.028885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.029700 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.029705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.029937 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.030568 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:27.030590 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:27.033095 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:27.036038 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:27.036078 (+ 40us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:27.036091 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:27.036741 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:27.037288 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:27.037292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:27.037295 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:27.037536 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:27.038304 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:27.038312 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:27.038708 (+ 396us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.038992 (+ 284us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.039460 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":273,"threads_started":1}
I20260810 03:17:27.041759 16298 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40443
I20260810 03:17:27.042018 16298 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:27.042663 16298 heartbeater.cc:511] Master 127.18.112.126:40443 requested a full tablet report, sending...
I20260810 03:17:27.043982 15792 ts_manager.cc:194] Registered new tserver with Master: 5e467d0aa59443adacff9e7c4132aef9 (127.18.112.66:44659)
I20260810 03:17:27.044773 15792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.66@KRBTEST.COM'} at 127.18.112.66:57917
WARNING: no policy specified for kudu/127.18.112.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
Entry for principal kudu/127.18.112.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab.
I20260810 03:17:27.086897 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:46753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:27.397791 16305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:27.398033 16305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:27.398161 16305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:27.404946 16305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:27.405043 16305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:27.405181 16305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:27.414283 16305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:46753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.67.keytab
--principal=kudu/127.18.112.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:40443
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:27.415354 16305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:27.416661 16305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:27.428419 16316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:27.428468 16320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:27.428375 16317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:27.429394 16305 server_base.cc:1034] running on GCE node
I20260810 03:17:27.429922 16305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:27.430711 16305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:27.431874 16305 hybrid_clock.cc:648] HybridClock initialized: now 1786331847431823 us; error 41 us; skew 500 ppm
I20260810 03:17:27.432152 16305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:27 dist-test-slave-jlzn krb5kdc[15715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331847, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:27.434955 16305 init.cc:377] Logged in from keytab as kudu/127.18.112.67@KRBTEST.COM (short username kudu)
I20260810 03:17:27.436270 16305 webserver.cc:460] Webserver started at http://127.18.112.67:33783/ using document root <none> and password file <none>
I20260810 03:17:27.436880 16305 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:27.436992 16305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:27.437280 16305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:27.440045 16305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "ccfe1e8b36554a3ea022f68090bae4ec"
format_stamp: "Formatted at 2026-08-10 03:17:27 on dist-test-slave-jlzn"
server_key: "19b3df6040f394c1ac85158880603f30"
server_key_iv: "ca4247c5bfc234600538d2f00c560499"
server_key_version: "encryptionkey@0"
I20260810 03:17:27.440757 16305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "ccfe1e8b36554a3ea022f68090bae4ec"
format_stamp: "Formatted at 2026-08-10 03:17:27 on dist-test-slave-jlzn"
server_key: "19b3df6040f394c1ac85158880603f30"
server_key_iv: "ca4247c5bfc234600538d2f00c560499"
server_key_version: "encryptionkey@0"
I20260810 03:17:27.445371 16305 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:27.448509 16333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:27.449774 16305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:27.449944 16305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "ccfe1e8b36554a3ea022f68090bae4ec"
format_stamp: "Formatted at 2026-08-10 03:17:27 on dist-test-slave-jlzn"
server_key: "19b3df6040f394c1ac85158880603f30"
server_key_iv: "ca4247c5bfc234600538d2f00c560499"
server_key_version: "encryptionkey@0"
I20260810 03:17:27.450115 16305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:27.467290 16305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:27.470767 16305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:27.470999 16305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:27.471879 16305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:27.473095 16305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:27.473174 16305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:27.473290 16305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:27.473343 16305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:27.502146 16305 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:40513
I20260810 03:17:27.502202 16517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:40513 every 8 connection(s)
I20260810 03:17:27.503248 16305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:27.508710 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 16305
I20260810 03:17:27.508881 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:27.509301 18881 external_mini_cluster.cc:1428] Setting key 3399f54a6ad9beeb86af3fa2aa4a151a
Aug 10 03:17:27 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331847, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.67@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:27.521298 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.505433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:55579 (local address 127.18.112.126:40443)
0810 03:17:27.505645 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.505652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.506658 (+ 1006us) server_negotiation.cc:407] Connection header received
0810 03:17:27.508340 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.508345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.508434 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.508545 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:27.509928 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.510892 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.512461 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.512863 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.512954 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.515861 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:27.515866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:27.515869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:27.515900 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:27.518293 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.519081 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.519084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.519087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.519215 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.519640 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.519643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.519644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.519935 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:27.520068 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.520706 (+ 638us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.520954 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:17:27.522050 16520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.505841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:40443 (local address 127.18.112.67:55579)
0810 03:17:27.506499 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.506534 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.508111 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.508707 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.508715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.509217 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:27.509763 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.509780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.511035 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.511040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.512341 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.512353 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.513030 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.513035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.513214 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.513727 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:17:27.513752 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:27.515657 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:27.518434 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:27.518442 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:27.518455 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:27.518983 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:27.519313 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:17:27.519317 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:17:27.519321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:17:27.519549 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:17:27.520058 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:27.520065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:27.520352 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.520593 (+ 241us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.521052 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":265,"threads_started":1}
I20260810 03:17:27.523262 16518 heartbeater.cc:347] Connected to a master server at 127.18.112.126:40443
I20260810 03:17:27.523552 16518 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:27.524304 16518 heartbeater.cc:511] Master 127.18.112.126:40443 requested a full tablet report, sending...
I20260810 03:17:27.525651 15791 ts_manager.cc:194] Registered new tserver with Master: ccfe1e8b36554a3ea022f68090bae4ec (127.18.112.67:40513)
I20260810 03:17:27.526445 15791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.112.67@KRBTEST.COM'} at 127.18.112.67:55579
I20260810 03:17:27.536309 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:27.546417 16092 heartbeater.cc:503] Master 127.18.112.126:40443 was elected leader, sending a full tablet report...
I20260810 03:17:27.552049 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.540156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.18.112.126:40443)
0810 03:17:27.540292 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.540296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.540719 (+ 423us) server_negotiation.cc:407] Connection header received
0810 03:17:27.540879 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.540883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.540937 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.541008 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:27.542413 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.543103 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.544399 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.544789 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.544899 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.547282 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:27.547287 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:27.547290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:27.547320 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:27.549637 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.550201 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.550207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.550211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.550339 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.550703 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.550707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.550709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.550979 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:27.551210 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.551531 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.551728 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:17:27.555205 15791 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:27.561841 15791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:27.591104 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.572574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.18.112.66:44659)
0810 03:17:27.583733 (+ 11159us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.583742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.583775 (+ 33us) server_negotiation.cc:407] Connection header received
0810 03:17:27.583901 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.583910 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.584152 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.584346 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:27.585282 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.586543 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.588754 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.590000 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.590133 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.590335 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.590652 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.590816 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10984,"thread_start_us":10878,"threads_started":1}
I20260810 03:17:27.591213 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.572587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:44659 (local address 127.0.0.1:46468)
0810 03:17:27.573272 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.573319 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.573463 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.584667 (+ 11204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.584675 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.584707 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:27.585084 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.585096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.586771 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.586776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.588564 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.588578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.590211 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.590218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.590438 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.590475 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.590588 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.590804 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":8,"thread_start_us":339,"threads_started":1}
I20260810 03:17:27.593541 16538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.573914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38574)
0810 03:17:27.585595 (+ 11681us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.585612 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.585722 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.586341 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.586347 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.586371 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:27.586765 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.586781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.588610 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.588616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.590955 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.590970 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.592737 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.592744 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.592898 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.592929 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.593037 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.593156 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11567,"mutex_wait_us":53,"thread_start_us":9213,"threads_started":1}
I20260810 03:17:27.593544 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.574518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.18.112.65:40281)
0810 03:17:27.582993 (+ 8475us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.583002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.585834 (+ 2832us) server_negotiation.cc:407] Connection header received
0810 03:17:27.585929 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.585936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.586154 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.586339 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:27.586927 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.588438 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.591123 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.592527 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.592676 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.592896 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.593076 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.593231 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8287,"thread_start_us":8132,"threads_started":1}
I20260810 03:17:27.594050 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.573662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:40513 (local address 127.0.0.1:49166)
0810 03:17:27.583411 (+ 9749us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.583430 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.583547 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.586609 (+ 3062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.586613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.586635 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:27.587090 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.587102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.589061 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.589066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.591281 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.591294 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.593270 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.593277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.593453 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.593483 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.593579 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.593695 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9616,"mutex_wait_us":40,"thread_start_us":11705,"threads_started":1}
I20260810 03:17:27.594736 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.573947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49166 (local address 127.18.112.67:40513)
0810 03:17:27.585939 (+ 11992us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.585947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.585973 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:17:27.586066 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.586073 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.586252 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.586414 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:27.587298 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.588897 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.591447 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.592786 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.592901 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.593105 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.594313 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.594427 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11827,"thread_start_us":11684,"threads_started":1}
I20260810 03:17:27.594991 16198 tablet_service.cc:1467] Processing CreateTablet for tablet d489e48314184ce186ded75ca6278cfd (DEFAULT_TABLE table=test-table [id=b85850dc61f84273adb8bc234b9b5eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:27.596501 16198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d489e48314184ce186ded75ca6278cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:27.597229 15991 tablet_service.cc:1467] Processing CreateTablet for tablet d489e48314184ce186ded75ca6278cfd (DEFAULT_TABLE table=test-table [id=b85850dc61f84273adb8bc234b9b5eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:27.597460 16405 tablet_service.cc:1467] Processing CreateTablet for tablet d489e48314184ce186ded75ca6278cfd (DEFAULT_TABLE table=test-table [id=b85850dc61f84273adb8bc234b9b5eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:27.598536 16405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d489e48314184ce186ded75ca6278cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:27.598551 15991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d489e48314184ce186ded75ca6278cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:27.609824 16544 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Bootstrap starting.
I20260810 03:17:27.611939 16548 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Bootstrap starting.
I20260810 03:17:27.613274 16547 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Bootstrap starting.
I20260810 03:17:27.614114 16544 tablet_bootstrap.cc:654] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:27.615239 16548 tablet_bootstrap.cc:654] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:27.615353 16544 log.cc:824] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:27.616119 16547 tablet_bootstrap.cc:654] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:27.616405 16548 log.cc:824] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:27.617267 16547 log.cc:824] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:27.618273 16544 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: No bootstrap required, opened a new log
I20260810 03:17:27.618541 16544 ts_tablet_manager.cc:1397] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 03:17:27.619190 16548 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: No bootstrap required, opened a new log
I20260810 03:17:27.619433 16548 ts_tablet_manager.cc:1397] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:17:27.619645 16547 tablet_bootstrap.cc:492] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: No bootstrap required, opened a new log
I20260810 03:17:27.619899 16547 ts_tablet_manager.cc:1397] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:17:27.626828 16547 raft_consensus.cc:348] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.627151 16547 raft_consensus.cc:374] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:27.627255 16547 raft_consensus.cc:729] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e467d0aa59443adacff9e7c4132aef9, State: Initialized, Role: FOLLOWER
I20260810 03:17:27.627771 16547 consensus_queue.cc:260] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.628798 16298 heartbeater.cc:503] Master 127.18.112.126:40443 was elected leader, sending a full tablet report...
I20260810 03:17:27.628954 16544 raft_consensus.cc:348] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.629251 16547 ts_tablet_manager.cc:1428] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260810 03:17:27.629347 16544 raft_consensus.cc:374] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:27.629449 16544 raft_consensus.cc:729] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccfe1e8b36554a3ea022f68090bae4ec, State: Initialized, Role: FOLLOWER
I20260810 03:17:27.630023 16544 consensus_queue.cc:260] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.631006 16518 heartbeater.cc:503] Master 127.18.112.126:40443 was elected leader, sending a full tablet report...
I20260810 03:17:27.631191 16548 raft_consensus.cc:348] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.631584 16548 raft_consensus.cc:374] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:27.631675 16548 raft_consensus.cc:729] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b964f54c1947e98be6bdb65cea68ce, State: Initialized, Role: FOLLOWER
I20260810 03:17:27.631708 16544 ts_tablet_manager.cc:1428] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260810 03:17:27.632504 16548 consensus_queue.cc:260] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.634063 16548 ts_tablet_manager.cc:1428] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260810 03:17:27.737406 16558 raft_consensus.cc:482] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:27.737744 16558 raft_consensus.cc:504] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.739486 16558 leader_election.cc:288] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e467d0aa59443adacff9e7c4132aef9 (127.18.112.66:44659), 08b964f54c1947e98be6bdb65cea68ce (127.18.112.65:40281)
I20260810 03:17:27.745622 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.739877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:58493 (local address 127.18.112.66:44659)
0810 03:17:27.740074 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.740080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.740336 (+ 256us) server_negotiation.cc:407] Connection header received
0810 03:17:27.740512 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.740517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.740576 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.740648 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:27.741068 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.742009 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.743775 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.744854 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.744960 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.745015 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.745334 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.745419 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:17:27.745855 16520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.739969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:44659 (local address 127.18.112.67:58493)
0810 03:17:27.740243 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.740266 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.740390 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.740699 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.740704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.740731 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:27.740925 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.740937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.742154 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.742160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.743612 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.743625 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.744997 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.745003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.745190 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.745227 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.745324 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.745454 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260810 03:17:27.746366 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.740045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.18.112.67:35271)
0810 03:17:27.740760 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:27.740773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:27.740883 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:27.741193 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:27.741197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:27.741222 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:27.741575 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.741586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.742787 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.742790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.744394 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:27.744409 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.745700 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.745706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:27.745869 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.745898 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:17:27.746023 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 03:17:27.746137 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":430,"threads_started":1}
I20260810 03:17:27.746405 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.740107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:35271 (local address 127.18.112.65:40281)
0810 03:17:27.740300 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.740306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.740860 (+ 554us) server_negotiation.cc:407] Connection header received
0810 03:17:27.740988 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.740993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.741068 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.741142 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:27.741703 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.742632 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.744539 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.745487 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.745633 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.745698 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.746069 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.746194 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:17:27.746886 16232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d489e48314184ce186ded75ca6278cfd" candidate_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e467d0aa59443adacff9e7c4132aef9" is_pre_election: true
I20260810 03:17:27.747349 16232 raft_consensus.cc:2454] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccfe1e8b36554a3ea022f68090bae4ec in term 0.
I20260810 03:17:27.747397 16018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d489e48314184ce186ded75ca6278cfd" candidate_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b964f54c1947e98be6bdb65cea68ce" is_pre_election: true
I20260810 03:17:27.747917 16018 raft_consensus.cc:2454] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccfe1e8b36554a3ea022f68090bae4ec in term 0.
I20260810 03:17:27.748003 16337 leader_election.cc:302] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e467d0aa59443adacff9e7c4132aef9, ccfe1e8b36554a3ea022f68090bae4ec; no voters:
I20260810 03:17:27.748369 16558 raft_consensus.cc:2781] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:27.748524 16558 raft_consensus.cc:482] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:27.748638 16558 raft_consensus.cc:3037] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:27.750751 16558 raft_consensus.cc:504] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.751247 16558 leader_election.cc:288] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [CANDIDATE]: Term 1 election: Requested vote from peers 5e467d0aa59443adacff9e7c4132aef9 (127.18.112.66:44659), 08b964f54c1947e98be6bdb65cea68ce (127.18.112.65:40281)
I20260810 03:17:27.751643 16232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d489e48314184ce186ded75ca6278cfd" candidate_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e467d0aa59443adacff9e7c4132aef9"
I20260810 03:17:27.751693 16018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d489e48314184ce186ded75ca6278cfd" candidate_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b964f54c1947e98be6bdb65cea68ce"
I20260810 03:17:27.751864 16232 raft_consensus.cc:3037] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:27.751875 16018 raft_consensus.cc:3037] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 0 FOLLOWER]: Advancing to term 1
W20260810 03:17:27.754690 16519 tablet.cc:2369] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:27.754921 16232 raft_consensus.cc:2454] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfe1e8b36554a3ea022f68090bae4ec in term 1.
I20260810 03:17:27.754921 16018 raft_consensus.cc:2454] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfe1e8b36554a3ea022f68090bae4ec in term 1.
I20260810 03:17:27.755270 16337 leader_election.cc:302] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e467d0aa59443adacff9e7c4132aef9, ccfe1e8b36554a3ea022f68090bae4ec; no voters:
I20260810 03:17:27.755533 16558 raft_consensus.cc:2781] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:27.755998 16558 raft_consensus.cc:686] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 1 LEADER]: Becoming Leader. State: Replica: ccfe1e8b36554a3ea022f68090bae4ec, State: Running, Role: LEADER
I20260810 03:17:27.756453 16558 consensus_queue.cc:237] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } }
I20260810 03:17:27.760754 15792 catalog_manager.cc:5495] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec reported cstate change: term changed from 0 to 1, leader changed from <none> to ccfe1e8b36554a3ea022f68090bae4ec (127.18.112.67). New cstate: current_term: 1 leader_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccfe1e8b36554a3ea022f68090bae4ec" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 40513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 } health_report { overall_health: UNKNOWN } } }
W20260810 03:17:27.770231 16093 tablet.cc:2369] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:17:27.771245 16300 tablet.cc:2369] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:27.815335 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.810577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.18.112.67:40513)
0810 03:17:27.810813 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.810817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.810834 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:17:27.811015 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.811019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.811095 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.811215 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:27.811527 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.812277 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.813536 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.813910 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.813995 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.814388 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:27.814883 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:27.814992 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.815029 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.815088 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260810 03:17:27.823016 16018 raft_consensus.cc:1261] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 1 FOLLOWER]: Refusing update from remote peer ccfe1e8b36554a3ea022f68090bae4ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:27.823024 16232 raft_consensus.cc:1261] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 1 FOLLOWER]: Refusing update from remote peer ccfe1e8b36554a3ea022f68090bae4ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:27.823951 16564 consensus_queue.cc:1035] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b964f54c1947e98be6bdb65cea68ce" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 40281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:27.824306 16558 consensus_queue.cc:1035] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e467d0aa59443adacff9e7c4132aef9" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 44659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:27.834285 16570 mvcc.cc:205] Tried to move back new op lower bound from 7316815248673280000 to 7316815248413728768. Current Snapshot: MvccSnapshot[applied={T|T < 7316815248673280000}]
I20260810 03:17:27.847787 15792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:27.848081 15792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:27.851253 15792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb4629ce5534477c80458d097f0c8c28: Sending DeleteTablet for 3 replicas of tablet d489e48314184ce186ded75ca6278cfd
I20260810 03:17:27.852232 16198 tablet_service.cc:1514] Processing DeleteTablet for tablet d489e48314184ce186ded75ca6278cfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:27 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:46468
I20260810 03:17:27.852339 16405 tablet_service.cc:1514] Processing DeleteTablet for tablet d489e48314184ce186ded75ca6278cfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:27 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:49166
I20260810 03:17:27.852512 15991 tablet_service.cc:1514] Processing DeleteTablet for tablet d489e48314184ce186ded75ca6278cfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:27 UTC) from {username='kudu', principal='kudu/127.18.112.126@KRBTEST.COM'} at 127.0.0.1:38574
I20260810 03:17:27.854177 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 15879
I20260810 03:17:27.884480 16589 tablet_replica.cc:330] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: stopping tablet replica
I20260810 03:17:27.886559 16591 tablet_replica.cc:330] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: stopping tablet replica
I20260810 03:17:27.886988 16591 raft_consensus.cc:2229] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:27.887951 16591 raft_consensus.cc:2258] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:27.888741 16592 tablet_replica.cc:330] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: stopping tablet replica
I20260810 03:17:27.889231 16592 raft_consensus.cc:2229] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:27.889780 16592 raft_consensus.cc:2258] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:27.892009 16591 ts_tablet_manager.cc:1905] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 03:17:27 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.65@KRBTEST.COM
I20260810 03:17:27.897460 16592 ts_tablet_manager.cc:1905] T d489e48314184ce186ded75ca6278cfd P 08b964f54c1947e98be6bdb65cea68ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:27.899371 16591 ts_tablet_manager.cc:1918] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:27.899608 16591 log.cc:1196] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/d489e48314184ce186ded75ca6278cfd
I20260810 03:17:27.900239 16591 ts_tablet_manager.cc:1939] T d489e48314184ce186ded75ca6278cfd P ccfe1e8b36554a3ea022f68090bae4ec: Deleting consensus metadata
I20260810 03:17:27.900187 16589 raft_consensus.cc:2229] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:27.900657 16589 raft_consensus.cc:2258] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:27.902103 15767 catalog_manager.cc:4841] TS ccfe1e8b36554a3ea022f68090bae4ec (127.18.112.67:40513): tablet d489e48314184ce186ded75ca6278cfd (table test-table [id=b85850dc61f84273adb8bc234b9b5eae]) successfully deleted
I20260810 03:17:27.902705 16589 ts_tablet_manager.cc:1905] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:27.903623 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:27.855240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38586 (local address 127.18.112.65:40281)
0810 03:17:27.855401 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:27.855407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:27.880026 (+ 24619us) server_negotiation.cc:407] Connection header received
0810 03:17:27.880478 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:27.880485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:27.880582 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:27.880666 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:27.882510 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.883858 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.886038 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:27.889367 (+ 3329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:27.889525 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:27.895131 (+ 5606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:27.895142 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:27.895159 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:27.895204 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:27.898993 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.899870 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.899879 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.899883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.900051 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:27.900464 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:27.900469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:27.900473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:27.900918 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:27.901432 (+ 514us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:27.902995 (+ 1563us) server_negotiation.cc:299] Negotiation successful
0810 03:17:27.903214 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:17:27.904994 16080 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:27.909571 16589 ts_tablet_manager.cc:1918] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:27.909729 16589 log.cc:1196] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/d489e48314184ce186ded75ca6278cfd
I20260810 03:17:27.910601 16589 ts_tablet_manager.cc:1939] T d489e48314184ce186ded75ca6278cfd P 5e467d0aa59443adacff9e7c4132aef9: Deleting consensus metadata
I20260810 03:17:27.912333 15767 catalog_manager.cc:4841] TS 5e467d0aa59443adacff9e7c4132aef9 (127.18.112.66:44659): tablet d489e48314184ce186ded75ca6278cfd (table test-table [id=b85850dc61f84273adb8bc234b9b5eae]) successfully deleted
I20260810 03:17:28.040577 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 15879
W20260810 03:17:28.070154 15770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.112.65:40281 (error 108)
I20260810 03:17:28.071431 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 16100
I20260810 03:17:28.071866 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.071398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38594)
0810 03:17:28.071574 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.071697 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:17:28.072250 15770 catalog_manager.cc:4584] TS 08b964f54c1947e98be6bdb65cea68ce (127.18.112.65:40281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d489e48314184ce186ded75ca6278cfd: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Aug 10 03:17:28 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.66@KRBTEST.COM
I20260810 03:17:28.085819 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.072302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.18.112.66:44659)
0810 03:17:28.072490 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:28.072495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:28.072516 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:17:28.072688 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:28.072693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:28.072756 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:28.072837 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:28.074117 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:28.074858 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:28.076166 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:28.076547 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:28.076656 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:28.080640 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:28.080652 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:28.080666 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:28.080697 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:28.083238 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:28.083879 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:28.083889 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:28.083892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:28.084015 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:28.084356 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:28.084361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:28.084364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:28.084725 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:28.085009 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:28.085291 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 03:17:28.085491 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 03:17:28.086421 16293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:28.125715 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.125299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38610)
0810 03:17:28.125486 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.125574 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260810 03:17:28.126662 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.126331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38626)
0810 03:17:28.126473 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.126555 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 03:17:28.186991 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.186527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38634)
0810 03:17:28.186732 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.186821 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 03:17:28.188063 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.187702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38650)
0810 03:17:28.187871 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.187941 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 03:17:28.230643 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 16100
I20260810 03:17:28.254063 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 16305
Aug 10 03:17:28 dist-test-slave-jlzn krb5kdc[15715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.67@KRBTEST.COM
I20260810 03:17:28.268584 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.268048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38656)
0810 03:17:28.268272 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.268378 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 03:17:28.269845 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.269326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38672)
0810 03:17:28.269612 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.269713 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260810 03:17:28.272324 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.254756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.18.112.67:40513)
0810 03:17:28.254919 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:28.254924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:28.254997 (+ 73us) server_negotiation.cc:407] Connection header received
0810 03:17:28.255196 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:28.255200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:28.255264 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:28.255349 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:28.257207 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:28.258173 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:28.260080 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:28.260592 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:28.260702 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:28.265796 (+ 5094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:28.265811 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:28.265826 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:28.265872 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:28.269415 (+ 3543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:28.270203 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:28.270216 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:28.270220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:28.270370 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:28.270758 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:28.270764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:28.270767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:28.271147 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:28.271465 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:28.271768 (+ 303us) server_negotiation.cc:299] Negotiation successful
0810 03:17:28.272015 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:17:28.273065 16506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:28.390759 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 16305
I20260810 03:17:28.415831 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 15737
I20260810 03:17:28.416901 15833 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:28.521755 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:28.521215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:40281 (local address 127.0.0.1:38684)
0810 03:17:28.521426 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:28.521540 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 03:17:28.521987 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 15737
2026-08-10T03:17:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4445 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T03:17:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:28Z Disabled control of system clock
I20260810 03:17:28.606890 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:37761
--webserver_interface=127.18.112.126
--webserver_port=0
--builtin_ntp_servers=127.18.112.84:34449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:37761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:28.925726 16603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:28.925978 16603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:28.926097 16603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:28.933100 16603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:28.933220 16603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:28.933284 16603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:28.933362 16603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:28.933418 16603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:28.942078 16603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:37761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:37761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:28.943141 16603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:28.944809 16603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:28.955511 16611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:28.955544 16615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:28.955570 16613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:28.956279 16603 server_base.cc:1034] running on GCE node
I20260810 03:17:28.956949 16603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:28.958146 16603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:28.959357 16603 hybrid_clock.cc:648] HybridClock initialized: now 1786331848959306 us; error 41 us; skew 500 ppm
I20260810 03:17:28.959652 16603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:28.961690 16603 webserver.cc:460] Webserver started at http://127.18.112.126:39277/ using document root <none> and password file <none>
I20260810 03:17:28.962301 16603 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:28.962399 16603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:28.962692 16603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:28.965394 16603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "a170562ca9f84c8e84642e3f45bb9d68"
format_stamp: "Formatted at 2026-08-10 03:17:28 on dist-test-slave-jlzn"
server_key: "e57b3a5cb7c6c178379df3a07a6a2d0f"
server_key_iv: "c7f46e9e22908ef9c6922dc1c400185f"
server_key_version: "encryptionkey@0"
I20260810 03:17:28.966135 16603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "a170562ca9f84c8e84642e3f45bb9d68"
format_stamp: "Formatted at 2026-08-10 03:17:28 on dist-test-slave-jlzn"
server_key: "e57b3a5cb7c6c178379df3a07a6a2d0f"
server_key_iv: "c7f46e9e22908ef9c6922dc1c400185f"
server_key_version: "encryptionkey@0"
I20260810 03:17:28.970762 16603 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260810 03:17:28.973953 16625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:28.975065 16603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:17:28.975226 16603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "a170562ca9f84c8e84642e3f45bb9d68"
format_stamp: "Formatted at 2026-08-10 03:17:28 on dist-test-slave-jlzn"
server_key: "e57b3a5cb7c6c178379df3a07a6a2d0f"
server_key_iv: "c7f46e9e22908ef9c6922dc1c400185f"
server_key_version: "encryptionkey@0"
I20260810 03:17:28.975412 16603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:28.990617 16603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:28.991298 16603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:28.991556 16603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:29.008319 16603 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:37761
I20260810 03:17:29.008351 16701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:37761 every 8 connection(s)
I20260810 03:17:29.009472 16603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:29.012791 16702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:29.016523 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 16603
I20260810 03:17:29.016700 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:29.017241 18881 external_mini_cluster.cc:1428] Setting key cf5110769deceb521db7d98a50400725
I20260810 03:17:29.023860 16702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: Bootstrap starting.
I20260810 03:17:29.027103 16702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:29.028252 16702 log.cc:824] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:29.031060 16702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: No bootstrap required, opened a new log
I20260810 03:17:29.031123 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:29.018927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.18.112.126:37761)
0810 03:17:29.019846 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:29.019860 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:29.019901 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:17:29.022495 (+ 2594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:29.022518 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:29.022917 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:29.023198 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:29.023776 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.025115 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.026934 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.027616 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.027760 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:29.028947 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:29.028961 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:29.028978 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:29.029636 (+ 658us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:29.029690 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:29.029719 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:29.029802 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:29.030005 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 03:17:29.030305 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":328,"threads_started":1}
I20260810 03:17:29.038497 16702 raft_consensus.cc:348] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } }
I20260810 03:17:29.038816 16702 raft_consensus.cc:374] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:29.038905 16702 raft_consensus.cc:729] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a170562ca9f84c8e84642e3f45bb9d68, State: Initialized, Role: FOLLOWER
I20260810 03:17:29.039446 16702 consensus_queue.cc:260] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } }
I20260810 03:17:29.039719 16702 raft_consensus.cc:388] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:29.039891 16702 raft_consensus.cc:482] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:29.040046 16702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:29.041980 16702 raft_consensus.cc:504] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } }
I20260810 03:17:29.042408 16702 leader_election.cc:302] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a170562ca9f84c8e84642e3f45bb9d68; no voters:
I20260810 03:17:29.042899 16702 leader_election.cc:288] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:29.043017 16710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:29.044080 16710 raft_consensus.cc:686] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [term 1 LEADER]: Becoming Leader. State: Replica: a170562ca9f84c8e84642e3f45bb9d68, State: Running, Role: LEADER
I20260810 03:17:29.044680 16710 consensus_queue.cc:237] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } }
I20260810 03:17:29.045148 16702 sys_catalog.cc:564] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:29.047506 16712 sys_catalog.cc:455] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a170562ca9f84c8e84642e3f45bb9d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } } }
I20260810 03:17:29.047948 16712 sys_catalog.cc:458] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:29.049474 16719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:29.049446 16713 sys_catalog.cc:455] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a170562ca9f84c8e84642e3f45bb9d68. Latest consensus state: current_term: 1 leader_uuid: "a170562ca9f84c8e84642e3f45bb9d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a170562ca9f84c8e84642e3f45bb9d68" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 37761 } } }
I20260810 03:17:29.049820 16713 sys_catalog.cc:458] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:29.054493 16719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:29.062929 16719 catalog_manager.cc:1347] Generated new cluster ID: 5469f7aef15241d9882912df9782e54a
I20260810 03:17:29.063035 16719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:29.091548 16719 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:29.092814 16719 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:29.099839 16719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: Generated new TSK 0
I20260810 03:17:29.100479 16719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:29.105866 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.65:0
--local_ip_for_outbound_sockets=127.18.112.65
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--builtin_ntp_servers=127.18.112.84:34449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:17:29.427439 16737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:29.427692 16737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:29.427834 16737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:29.434710 16737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:29.434804 16737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:29.434943 16737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.65
I20260810 03:17:29.443435 16737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.112.65
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.65
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:29.444547 16737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:29.446187 16737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:29.458231 16749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:29.458317 16745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:29.458340 16747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:29.459079 16737 server_base.cc:1034] running on GCE node
I20260810 03:17:29.459589 16737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:29.460433 16737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:29.461620 16737 hybrid_clock.cc:648] HybridClock initialized: now 1786331849461572 us; error 40 us; skew 500 ppm
I20260810 03:17:29.461881 16737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:29.463900 16737 webserver.cc:460] Webserver started at http://127.18.112.65:37131/ using document root <none> and password file <none>
I20260810 03:17:29.464531 16737 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:29.464632 16737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:29.464932 16737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:29.467514 16737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data/instance:
uuid: "0d91775fa8b04c37a4fe1d6369861d1d"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "07553108ce9cc5b7d9c29495235b5a0f"
server_key_iv: "1e461ba0277e40aa4c91f1ce3efe198a"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.468268 16737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance:
uuid: "0d91775fa8b04c37a4fe1d6369861d1d"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "07553108ce9cc5b7d9c29495235b5a0f"
server_key_iv: "1e461ba0277e40aa4c91f1ce3efe198a"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.472888 16737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:29.475965 16763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.477105 16737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:29.477258 16737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal
uuid: "0d91775fa8b04c37a4fe1d6369861d1d"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "07553108ce9cc5b7d9c29495235b5a0f"
server_key_iv: "1e461ba0277e40aa4c91f1ce3efe198a"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.477447 16737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:29.494908 16737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:29.495568 16737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:29.495880 16737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:29.496729 16737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:29.498021 16737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:29.498116 16737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.498219 16737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:29.498293 16737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.526947 16737 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.65:34255
I20260810 03:17:29.527002 16947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.65:34255 every 8 connection(s)
I20260810 03:17:29.528113 16737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/data/info.pb
I20260810 03:17:29.534485 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 16737
I20260810 03:17:29.534631 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-0/wal/instance
I20260810 03:17:29.535089 18881 external_mini_cluster.cc:1428] Setting key 2d7f1b22e4b6ef9df3e8bebf09717025
I20260810 03:17:29.537748 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.66:0
--local_ip_for_outbound_sockets=127.18.112.66
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--builtin_ntp_servers=127.18.112.84:34449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:29.540414 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:29.530413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:55263 (local address 127.18.112.126:37761)
0810 03:17:29.530590 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:29.530595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:29.531976 (+ 1381us) server_negotiation.cc:407] Connection header received
0810 03:17:29.533920 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:29.533925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:29.533994 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:29.534077 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:29.535065 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.536004 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.537834 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.538381 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.538502 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:29.539699 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:29.539705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:29.539709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:29.539729 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:29.539768 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:29.539782 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:29.539882 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:29.540043 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 03:17:29.540129 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:17:29.541195 16952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:29.530954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:37761 (local address 127.18.112.65:55263)
0810 03:17:29.531830 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:29.531874 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:29.533694 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:29.534251 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:29.534258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:29.534334 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:29.534897 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:29.534915 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.536151 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.536156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:29.537678 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:29.537700 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.538569 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.538574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:29.538780 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:29.539397 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:29.539400 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:29.539438 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:29.539512 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:29.539878 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:29.539885 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:29.539891 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:17:29.540019 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 03:17:29.540279 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":267,"threads_started":1}
I20260810 03:17:29.542482 16950 heartbeater.cc:347] Connected to a master server at 127.18.112.126:37761
I20260810 03:17:29.542773 16950 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:29.543550 16950 heartbeater.cc:511] Master 127.18.112.126:37761 requested a full tablet report, sending...
I20260810 03:17:29.545531 16649 ts_manager.cc:194] Registered new tserver with Master: 0d91775fa8b04c37a4fe1d6369861d1d (127.18.112.65:34255)
I20260810 03:17:29.547020 16649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.65:55263
W20260810 03:17:29.859311 16953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:29.859561 16953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:29.859680 16953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:29.866701 16953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:29.866794 16953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:29.866930 16953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.66
I20260810 03:17:29.875427 16953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.112.66
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.66
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:29.876545 16953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:29.878208 16953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:29.890071 16961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:29.890112 16963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:29.890151 16965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:29.891050 16953 server_base.cc:1034] running on GCE node
I20260810 03:17:29.891635 16953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:29.892519 16953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:29.893707 16953 hybrid_clock.cc:648] HybridClock initialized: now 1786331849893649 us; error 52 us; skew 500 ppm
I20260810 03:17:29.893976 16953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:29.896031 16953 webserver.cc:460] Webserver started at http://127.18.112.66:42925/ using document root <none> and password file <none>
I20260810 03:17:29.896644 16953 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:29.896746 16953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:29.897029 16953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:29.899618 16953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data/instance:
uuid: "89e6f01061564d95a75034e74d4b3347"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "9b5eab7fa7e6564977167eb528b7ab8c"
server_key_iv: "74d19490f60813079e3d2e5a5034b6f3"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.900408 16953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance:
uuid: "89e6f01061564d95a75034e74d4b3347"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "9b5eab7fa7e6564977167eb528b7ab8c"
server_key_iv: "74d19490f60813079e3d2e5a5034b6f3"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.904939 16953 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:17:29.907980 16977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.909097 16953 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:29.909247 16953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal
uuid: "89e6f01061564d95a75034e74d4b3347"
format_stamp: "Formatted at 2026-08-10 03:17:29 on dist-test-slave-jlzn"
server_key: "9b5eab7fa7e6564977167eb528b7ab8c"
server_key_iv: "74d19490f60813079e3d2e5a5034b6f3"
server_key_version: "encryptionkey@0"
I20260810 03:17:29.909427 16953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:29.927109 16953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:29.927830 16953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:29.928107 16953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:29.928944 16953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:29.930299 16953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:29.930387 16953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.930486 16953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:29.930552 16953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:29.959833 16953 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.66:41807
I20260810 03:17:29.959872 17175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.66:41807 every 8 connection(s)
I20260810 03:17:29.961005 16953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/data/info.pb
I20260810 03:17:29.965536 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 16953
I20260810 03:17:29.965706 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal/instance
I20260810 03:17:29.966261 18881 external_mini_cluster.cc:1428] Setting key b17481558dcc7c635d3c549f029d81a6
I20260810 03:17:29.969156 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.112.67:0
--local_ip_for_outbound_sockets=127.18.112.67
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--builtin_ntp_servers=127.18.112.84:34449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:17:29.973840 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:29.963284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.66:52177 (local address 127.18.112.126:37761)
0810 03:17:29.963446 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:29.963451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:29.964722 (+ 1271us) server_negotiation.cc:407] Connection header received
0810 03:17:29.966939 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:29.966945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:29.967030 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:29.967121 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:29.968139 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.969203 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.971289 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.971725 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.971863 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:29.973187 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:29.973192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:29.973195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:29.973211 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:29.973242 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:29.973254 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:29.973322 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:29.973519 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 03:17:29.973598 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:17:29.974961 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:29.963728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:37761 (local address 127.18.112.66:52177)
0810 03:17:29.964582 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:29.964615 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:29.966635 (+ 2020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:29.967340 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:29.967348 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:29.967427 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:29.967984 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:29.968002 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.969416 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.969420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:29.971141 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:29.971156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:29.971951 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:29.971957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:29.972224 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:29.972883 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:29.972886 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:29.972929 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:29.973018 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:29.973337 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:29.973346 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:29.973353 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:29.973503 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 03:17:29.973826 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":250,"threads_started":1}
I20260810 03:17:29.976251 17176 heartbeater.cc:347] Connected to a master server at 127.18.112.126:37761
I20260810 03:17:29.976500 17176 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:29.977157 17176 heartbeater.cc:511] Master 127.18.112.126:37761 requested a full tablet report, sending...
I20260810 03:17:29.978438 16649 ts_manager.cc:194] Registered new tserver with Master: 89e6f01061564d95a75034e74d4b3347 (127.18.112.66:41807)
I20260810 03:17:29.979300 16649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.66:52177
W20260810 03:17:30.289362 17180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:30.289601 17180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:30.289721 17180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:30.296517 17180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:30.296602 17180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:30.296736 17180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.112.67
I20260810 03:17:30.305145 17180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.112.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.112.67
--webserver_port=0
--tserver_master_addrs=127.18.112.126:37761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.112.67
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:30.306169 17180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:30.307825 17180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:30.320007 17187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:30.320063 17189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:30.320056 17192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:30.320780 17180 server_base.cc:1034] running on GCE node
I20260810 03:17:30.321354 17180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:30.322180 17180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:30.323395 17180 hybrid_clock.cc:648] HybridClock initialized: now 1786331850323343 us; error 43 us; skew 500 ppm
I20260810 03:17:30.323688 17180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 03:17:30.325809 17180 webserver.cc:460] Webserver started at http://127.18.112.67:40237/ using document root <none> and password file <none>
I20260810 03:17:30.326424 17180 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:30.326526 17180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:30.326825 17180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:30.329459 17180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data/instance:
uuid: "3584c4c9387b434fbb1f2ecd7eec647d"
format_stamp: "Formatted at 2026-08-10 03:17:30 on dist-test-slave-jlzn"
server_key: "d345bdec767e1e46f16493aa6638a050"
server_key_iv: "5c548462c5290798bb9f22cb9e81f556"
server_key_version: "encryptionkey@0"
I20260810 03:17:30.330219 17180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance:
uuid: "3584c4c9387b434fbb1f2ecd7eec647d"
format_stamp: "Formatted at 2026-08-10 03:17:30 on dist-test-slave-jlzn"
server_key: "d345bdec767e1e46f16493aa6638a050"
server_key_iv: "5c548462c5290798bb9f22cb9e81f556"
server_key_version: "encryptionkey@0"
I20260810 03:17:30.334849 17180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 03:17:30.337990 17204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:30.339145 17180 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:17:30.339293 17180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal
uuid: "3584c4c9387b434fbb1f2ecd7eec647d"
format_stamp: "Formatted at 2026-08-10 03:17:30 on dist-test-slave-jlzn"
server_key: "d345bdec767e1e46f16493aa6638a050"
server_key_iv: "5c548462c5290798bb9f22cb9e81f556"
server_key_version: "encryptionkey@0"
I20260810 03:17:30.339478 17180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:30.354743 17180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:30.355417 17180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:30.355679 17180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:30.356565 17180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:17:30.357898 17180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:17:30.358000 17180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:30.358099 17180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:17:30.358168 17180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:30.387598 17180 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.67:44981
I20260810 03:17:30.387660 17388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.67:44981 every 8 connection(s)
I20260810 03:17:30.388816 17180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/data/info.pb
I20260810 03:17:30.397104 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 17180
I20260810 03:17:30.397265 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal/instance
I20260810 03:17:30.397755 18881 external_mini_cluster.cc:1428] Setting key f96f97c65c54346cdb4eb9804c128a7a
I20260810 03:17:30.400269 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.391078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.67:57459 (local address 127.18.112.126:37761)
0810 03:17:30.391293 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.391300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.392587 (+ 1287us) server_negotiation.cc:407] Connection header received
0810 03:17:30.394192 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.394196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.394263 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.394346 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:30.395269 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.396014 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.397516 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.398105 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.398227 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.399531 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:30.399537 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:30.399541 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:30.399561 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:30.399598 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:30.399615 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:30.399703 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.399938 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.400036 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:17:30.401280 17396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.391600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:37761 (local address 127.18.112.67:57459)
0810 03:17:30.392441 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.392481 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.393974 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.394518 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.394525 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.394600 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:17:30.395116 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.395144 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.396138 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.396141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.397361 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.397375 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.398350 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.398358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.398580 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.399220 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:17:30.399223 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:17:30.399271 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:17:30.399358 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:17:30.399724 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:17:30.399735 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:17:30.399742 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.399932 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.400290 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":275,"threads_started":1}
I20260810 03:17:30.402433 17389 heartbeater.cc:347] Connected to a master server at 127.18.112.126:37761
I20260810 03:17:30.402658 17389 heartbeater.cc:464] Registering TS with master...
I20260810 03:17:30.403312 17389 heartbeater.cc:511] Master 127.18.112.126:37761 requested a full tablet report, sending...
I20260810 03:17:30.404546 16649 ts_manager.cc:194] Registered new tserver with Master: 3584c4c9387b434fbb1f2ecd7eec647d (127.18.112.67:44981)
I20260810 03:17:30.405272 16649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.112.67:57459
I20260810 03:17:30.412660 18881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:17:30.421504 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.416467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42926 (local address 127.18.112.126:37761)
0810 03:17:30.416648 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.416654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.416993 (+ 339us) server_negotiation.cc:407] Connection header received
0810 03:17:30.417137 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.417140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.417214 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.417287 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:30.417729 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.418414 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.419604 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.420030 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.420117 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.420937 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:30.420942 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:30.420945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:30.420960 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:30.420988 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:30.420999 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:30.421061 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.421147 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.421218 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:17:30.424823 16649 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:17:30.431186 16649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:17:30.464521 17414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.442757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:41807 (local address 127.0.0.1:37194)
0810 03:17:30.454991 (+ 12234us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.455004 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.455199 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.456138 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.456143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.456176 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:30.456614 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.456635 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.458602 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.458608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.461187 (+ 2579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.461204 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.463495 (+ 2291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.463501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.463728 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.463777 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.463906 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.464086 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12136,"mutex_wait_us":26,"thread_start_us":10173,"threads_started":1}
I20260810 03:17:30.465540 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.443071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37194 (local address 127.18.112.66:41807)
0810 03:17:30.454039 (+ 10968us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.454047 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.455097 (+ 1050us) server_negotiation.cc:407] Connection header received
0810 03:17:30.455391 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.455398 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.455618 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.455789 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:30.456808 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.458407 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.461446 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.462946 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.463054 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.463326 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.464973 (+ 1647us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.465156 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10805,"thread_start_us":11350,"threads_started":1}
I20260810 03:17:30.466270 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.442110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:44981 (local address 127.0.0.1:38978)
0810 03:17:30.453738 (+ 11628us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.453773 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.453935 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.455926 (+ 1991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.455935 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.455969 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:30.456437 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.456453 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.459660 (+ 3207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.459665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.462034 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.462051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.465449 (+ 3398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.465455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.465655 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.465684 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.465750 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.465882 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11353,"mutex_wait_us":1,"thread_start_us":12649,"threads_started":1}
I20260810 03:17:30.467245 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.442421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38978 (local address 127.18.112.67:44981)
0810 03:17:30.455019 (+ 12598us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.455026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.455060 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:17:30.455146 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.455153 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.455408 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.455598 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:30.456707 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.459476 (+ 2769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.462286 (+ 2810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.463716 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.464950 (+ 1234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.465260 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.466741 (+ 1481us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.466896 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12432,"thread_start_us":12282,"threads_started":1}
I20260810 03:17:30.469287 17063 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 (DEFAULT_TABLE table=test-table [id=31cbdf9a06f741738df818c77a31f881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:30.470782 17063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7744faa73a4da99d977a08a238d5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:30.470733 17296 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 (DEFAULT_TABLE table=test-table [id=31cbdf9a06f741738df818c77a31f881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:30.472141 17296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7744faa73a4da99d977a08a238d5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:30.474237 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.455141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59366)
0810 03:17:30.466471 (+ 11330us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.466490 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.466584 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.467829 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.467833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.467859 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:30.468006 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.468017 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.469851 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.469857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.471751 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.471766 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.473540 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.473546 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.473742 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.473775 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.473864 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.473993 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11247,"thread_start_us":12116,"threads_started":1}
I20260810 03:17:30.474411 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.455380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59366 (local address 127.18.112.65:34255)
0810 03:17:30.467285 (+ 11905us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.467293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.467321 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:17:30.467417 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.467424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.467622 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.467831 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:30.468140 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.469644 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.472041 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.473367 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.473498 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.473711 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.473941 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.474094 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11777,"thread_start_us":11691,"threads_started":1}
I20260810 03:17:30.478099 16831 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 (DEFAULT_TABLE table=test-table [id=31cbdf9a06f741738df818c77a31f881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:17:30.479458 16831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7744faa73a4da99d977a08a238d5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:30.483326 17426 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Bootstrap starting.
I20260810 03:17:30.486276 17426 tablet_bootstrap.cc:654] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:30.487224 17426 log.cc:824] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:30.488047 17427 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Bootstrap starting.
I20260810 03:17:30.491096 17427 tablet_bootstrap.cc:654] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:30.491309 17426 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: No bootstrap required, opened a new log
I20260810 03:17:30.491590 17426 ts_tablet_manager.cc:1397] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 03:17:30.492318 17427 log.cc:824] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:30.494122 17432 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Bootstrap starting.
I20260810 03:17:30.495085 17427 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: No bootstrap required, opened a new log
I20260810 03:17:30.495347 17427 ts_tablet_manager.cc:1397] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260810 03:17:30.496682 17432 tablet_bootstrap.cc:654] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:30.497560 17432 log.cc:824] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:30.499720 17432 tablet_bootstrap.cc:492] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: No bootstrap required, opened a new log
I20260810 03:17:30.499976 17432 ts_tablet_manager.cc:1397] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260810 03:17:30.501398 17426 raft_consensus.cc:348] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.501821 17426 raft_consensus.cc:374] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:30.501914 17426 raft_consensus.cc:729] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584c4c9387b434fbb1f2ecd7eec647d, State: Initialized, Role: FOLLOWER
I20260810 03:17:30.502481 17426 consensus_queue.cc:260] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.505303 17427 raft_consensus.cc:348] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.505717 17427 raft_consensus.cc:374] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:30.505874 17427 raft_consensus.cc:729] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89e6f01061564d95a75034e74d4b3347, State: Initialized, Role: FOLLOWER
I20260810 03:17:30.506358 17389 heartbeater.cc:503] Master 127.18.112.126:37761 was elected leader, sending a full tablet report...
I20260810 03:17:30.506598 17427 consensus_queue.cc:260] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.507222 17432 raft_consensus.cc:348] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.507685 17432 raft_consensus.cc:374] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:30.507822 17426 ts_tablet_manager.cc:1428] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260810 03:17:30.507853 17432 raft_consensus.cc:729] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d91775fa8b04c37a4fe1d6369861d1d, State: Initialized, Role: FOLLOWER
I20260810 03:17:30.508673 17176 heartbeater.cc:503] Master 127.18.112.126:37761 was elected leader, sending a full tablet report...
I20260810 03:17:30.509341 17427 ts_tablet_manager.cc:1428] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260810 03:17:30.509689 17432 consensus_queue.cc:260] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.510767 16950 heartbeater.cc:503] Master 127.18.112.126:37761 was elected leader, sending a full tablet report...
I20260810 03:17:30.511404 17432 ts_tablet_manager.cc:1428] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Time spent starting tablet: real 0.011s user 0.006s sys 0.003s
W20260810 03:17:30.530149 16951 tablet.cc:2369] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:17:30.545652 17436 raft_consensus.cc:482] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:17:30.545900 17436 raft_consensus.cc:504] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.547397 17436 leader_election.cc:288] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3584c4c9387b434fbb1f2ecd7eec647d (127.18.112.67:44981), 89e6f01061564d95a75034e74d4b3347 (127.18.112.66:41807)
I20260810 03:17:30.555030 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.548126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:36457 (local address 127.18.112.66:41807)
0810 03:17:30.548297 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.548303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.548792 (+ 489us) server_negotiation.cc:407] Connection header received
0810 03:17:30.548925 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.548928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.548981 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.549046 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:30.549588 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.550489 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.552841 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.554013 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.554151 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.554222 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.554672 (+ 450us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.554795 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:17:30.555028 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.547760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.112.65:51159 (local address 127.18.112.67:44981)
0810 03:17:30.547972 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.547978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.548351 (+ 373us) server_negotiation.cc:407] Connection header received
0810 03:17:30.548532 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.548537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.548614 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.548695 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:17:30.549228 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.550192 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.552775 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.553975 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.554150 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.554219 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.554675 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.554800 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 03:17:30.555146 17439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.547558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.67:44981 (local address 127.18.112.65:51159)
0810 03:17:30.548241 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.548261 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.548403 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.548734 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.548739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.548766 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:30.549089 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.549100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.550329 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.550332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.552503 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.552519 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.554174 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.554185 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.554441 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.554538 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.554628 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.554763 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":67,"thread_start_us":371,"threads_started":1}
I20260810 03:17:30.555455 17444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.547856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.66:41807 (local address 127.18.112.65:36457)
0810 03:17:30.548690 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.548705 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:17:30.548819 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:17:30.549093 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:17:30.549097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:17:30.549121 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:17:30.549445 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.549452 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.550600 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.550604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.552657 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:17:30.552668 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.554207 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.554214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:17:30.554437 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.554542 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 03:17:30.554625 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 03:17:30.554763 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":72,"thread_start_us":532,"threads_started":1}
I20260810 03:17:30.556193 17319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e7744faa73a4da99d977a08a238d5a5" candidate_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" is_pre_election: true
I20260810 03:17:30.556360 17103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e7744faa73a4da99d977a08a238d5a5" candidate_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89e6f01061564d95a75034e74d4b3347" is_pre_election: true
I20260810 03:17:30.556766 17319 raft_consensus.cc:2454] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d91775fa8b04c37a4fe1d6369861d1d in term 0.
I20260810 03:17:30.556829 17103 raft_consensus.cc:2454] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d91775fa8b04c37a4fe1d6369861d1d in term 0.
I20260810 03:17:30.557473 16768 leader_election.cc:302] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d91775fa8b04c37a4fe1d6369861d1d, 3584c4c9387b434fbb1f2ecd7eec647d, 89e6f01061564d95a75034e74d4b3347; no voters:
I20260810 03:17:30.557865 17436 raft_consensus.cc:2781] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:17:30.557986 17436 raft_consensus.cc:482] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:17:30.558072 17436 raft_consensus.cc:3037] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:30.560096 17436 raft_consensus.cc:504] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.560600 17436 leader_election.cc:288] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [CANDIDATE]: Term 1 election: Requested vote from peers 3584c4c9387b434fbb1f2ecd7eec647d (127.18.112.67:44981), 89e6f01061564d95a75034e74d4b3347 (127.18.112.66:41807)
I20260810 03:17:30.561000 17319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e7744faa73a4da99d977a08a238d5a5" candidate_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3584c4c9387b434fbb1f2ecd7eec647d"
I20260810 03:17:30.561019 17103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e7744faa73a4da99d977a08a238d5a5" candidate_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89e6f01061564d95a75034e74d4b3347"
I20260810 03:17:30.561156 17319 raft_consensus.cc:3037] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:30.561172 17103 raft_consensus.cc:3037] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:30.563253 17103 raft_consensus.cc:2454] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d91775fa8b04c37a4fe1d6369861d1d in term 1.
I20260810 03:17:30.563315 17319 raft_consensus.cc:2454] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d91775fa8b04c37a4fe1d6369861d1d in term 1.
I20260810 03:17:30.563706 16765 leader_election.cc:302] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d91775fa8b04c37a4fe1d6369861d1d, 3584c4c9387b434fbb1f2ecd7eec647d; no voters:
I20260810 03:17:30.563989 17436 raft_consensus.cc:2781] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:30.564435 17436 raft_consensus.cc:686] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 1 LEADER]: Becoming Leader. State: Replica: 0d91775fa8b04c37a4fe1d6369861d1d, State: Running, Role: LEADER
I20260810 03:17:30.564906 17436 consensus_queue.cc:237] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } }
I20260810 03:17:30.568761 16648 catalog_manager.cc:5495] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d91775fa8b04c37a4fe1d6369861d1d (127.18.112.65). New cstate: current_term: 1 leader_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d91775fa8b04c37a4fe1d6369861d1d" member_type: VOTER last_known_addr { host: "127.18.112.65" port: 34255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 } health_report { overall_health: UNKNOWN } } }
I20260810 03:17:30.604367 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.599508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.18.112.65:34255)
0810 03:17:30.599702 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.599708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.599725 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:17:30.599790 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.599794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.599900 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.600019 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:17:30.600369 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.601030 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.602394 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.602794 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.602900 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.603352 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:17:30.603790 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:17:30.603937 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.604051 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.604123 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:17:30.611392 17103 raft_consensus.cc:1261] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 1 FOLLOWER]: Refusing update from remote peer 0d91775fa8b04c37a4fe1d6369861d1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:30.611413 17319 raft_consensus.cc:1261] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 1 FOLLOWER]: Refusing update from remote peer 0d91775fa8b04c37a4fe1d6369861d1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:17:30.612233 17436 consensus_queue.cc:1035] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89e6f01061564d95a75034e74d4b3347" member_type: VOTER last_known_addr { host: "127.18.112.66" port: 41807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:30.612488 17445 consensus_queue.cc:1035] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3584c4c9387b434fbb1f2ecd7eec647d" member_type: VOTER last_known_addr { host: "127.18.112.67" port: 44981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:17:30.633867 16649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:30.634137 16649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:17:30.637553 16649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a170562ca9f84c8e84642e3f45bb9d68: Sending DeleteTablet for 3 replicas of tablet 9e7744faa73a4da99d977a08a238d5a5
I20260810 03:17:30.638574 17296 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:30 UTC) from {username='slave'} at 127.0.0.1:38978
I20260810 03:17:30.638605 16831 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:30 UTC) from {username='slave'} at 127.0.0.1:59366
I20260810 03:17:30.638935 17063 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7744faa73a4da99d977a08a238d5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:17:30 UTC) from {username='slave'} at 127.0.0.1:37194
I20260810 03:17:30.641710 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 16737
I20260810 03:17:30.674154 17460 tablet_replica.cc:330] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: stopping tablet replica
I20260810 03:17:30.675177 17462 tablet_replica.cc:330] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: stopping tablet replica
I20260810 03:17:30.675307 17460 raft_consensus.cc:2229] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:30.675608 17462 raft_consensus.cc:2229] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:17:30.675884 17460 raft_consensus.cc:2258] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:30.676316 17462 raft_consensus.cc:2258] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:30.676744 17425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.643300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59382 (local address 127.18.112.65:34255)
0810 03:17:30.643469 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.643476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.666149 (+ 22673us) server_negotiation.cc:407] Connection header received
0810 03:17:30.666647 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.666654 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.666763 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.666838 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:30.667515 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.668881 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.670933 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.671684 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.671782 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.674790 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:30.674804 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:30.674823 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:30.675608 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:30.675667 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:30.675701 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:30.675837 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.676170 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.676284 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:17:30.678023 16939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:30.678402 17460 ts_tablet_manager.cc:1905] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:30.678486 17463 tablet_replica.cc:330] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: stopping tablet replica
I20260810 03:17:30.678928 17463 raft_consensus.cc:2229] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:17:30.679458 17463 raft_consensus.cc:2258] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:17:30.681505 17463 ts_tablet_manager.cc:1905] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:30.684566 17460 ts_tablet_manager.cc:1918] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:30.684697 17460 log.cc:1196] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-2/wal/wals/9e7744faa73a4da99d977a08a238d5a5
I20260810 03:17:30.685120 17460 ts_tablet_manager.cc:1939] T 9e7744faa73a4da99d977a08a238d5a5 P 3584c4c9387b434fbb1f2ecd7eec647d: Deleting consensus metadata
I20260810 03:17:30.686607 16628 catalog_manager.cc:4841] TS 3584c4c9387b434fbb1f2ecd7eec647d (127.18.112.67:44981): tablet 9e7744faa73a4da99d977a08a238d5a5 (table test-table [id=31cbdf9a06f741738df818c77a31f881]) successfully deleted
I20260810 03:17:30.688289 17463 ts_tablet_manager.cc:1918] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:17:30.688444 17463 log.cc:1196] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Deleting WAL directory at /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786331536832683-18881-0/minicluster-data/ts-1/wal/wals/9e7744faa73a4da99d977a08a238d5a5
I20260810 03:17:30.688947 17463 ts_tablet_manager.cc:1939] T 9e7744faa73a4da99d977a08a238d5a5 P 89e6f01061564d95a75034e74d4b3347: Deleting consensus metadata
I20260810 03:17:30.690459 16631 catalog_manager.cc:4841] TS 89e6f01061564d95a75034e74d4b3347 (127.18.112.66:41807): tablet 9e7744faa73a4da99d977a08a238d5a5 (table test-table [id=31cbdf9a06f741738df818c77a31f881]) successfully deleted
I20260810 03:17:30.678408 17462 ts_tablet_manager.cc:1905] T 9e7744faa73a4da99d977a08a238d5a5 P 0d91775fa8b04c37a4fe1d6369861d1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:17:30.774214 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 16737
W20260810 03:17:30.796386 16628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.112.65:34255 (error 108)
I20260810 03:17:30.796622 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 16953
I20260810 03:17:30.798419 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.797862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59390)
0810 03:17:30.798087 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.798218 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 03:17:30.798660 16628 catalog_manager.cc:4584] TS 0d91775fa8b04c37a4fe1d6369861d1d (127.18.112.65:34255): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e7744faa73a4da99d977a08a238d5a5: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
I20260810 03:17:30.803220 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.797330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37200 (local address 127.18.112.66:41807)
0810 03:17:30.797507 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.797512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.797561 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:17:30.797807 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.797813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.797920 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.798045 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:30.798483 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.799269 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.800700 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.801089 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.801187 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.802074 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:30.802081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:30.802095 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:30.802660 (+ 565us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:30.802706 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:30.802726 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:30.802815 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.802892 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.802972 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:17:30.803900 17171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:30.852219 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.851739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59404)
0810 03:17:30.851956 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.852047 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260810 03:17:30.853282 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.852865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59414)
0810 03:17:30.853019 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.853099 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 03:17:30.891820 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 16953
I20260810 03:17:30.913257 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17180
I20260810 03:17:30.913829 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.913424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59418)
0810 03:17:30.913597 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.913674 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:17:30.914986 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.914558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59430)
0810 03:17:30.914717 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.914807 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:17:30.923127 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.913979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.18.112.67:44981)
0810 03:17:30.914189 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:30.914195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:30.914219 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:17:30.914447 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:30.914453 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:30.914565 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:30.914678 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:30.915221 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.915999 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.917250 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:30.917658 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:30.917751 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:30.921947 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:30.921958 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:30.921974 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:30.922508 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:30.922555 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:30.922575 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:30.922688 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:30.922763 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 03:17:30.922856 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:17:30.923696 17381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:30.995462 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.995053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59434)
0810 03:17:30.995249 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.995333 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 03:17:30.996523 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:30.996112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.65:34255 (local address 127.0.0.1:59448)
0810 03:17:30.996291 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 03:17:30.996378 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.65:34255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260810 03:17:31.009635 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 17180
I20260810 03:17:31.029868 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 16603
I20260810 03:17:31.030824 16695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:31.152359 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 16603
2026-08-10T03:17:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2634 ms)
[----------] 6 tests from EncryptionPolicyTest (20998 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:31 dist-test-slave-jlzn krb5kdc[17479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:31 dist-test-slave-jlzn krb5kdc[17479](info): set up 2 sockets
Aug 10 03:17:31 dist-test-slave-jlzn krb5kdc[17479](info): commencing operation
krb5kdc: starting...
W20260810 03:17:32.356132 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:32 dist-test-slave-jlzn krb5kdc[17479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:32.602677 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:32.921416 17496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:32.921766 17496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:32.921907 17496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:32.928768 17496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:32.928874 17496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:32.928948 17496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:32.929028 17496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:32.929085 17496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:32.938212 17496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40117
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:32.939340 17496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:32.940565 17496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:32.951319 17504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:32.951381 17503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:32.951408 17508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:32.952280 17496 server_base.cc:1034] running on GCE node
I20260810 03:17:32.952972 17496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:32.954187 17496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:32.955394 17496 hybrid_clock.cc:648] HybridClock initialized: now 1786331852955343 us; error 40 us; skew 500 ppm
I20260810 03:17:32.955719 17496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:32 dist-test-slave-jlzn krb5kdc[17479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331852, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:32.958734 17496 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:32.960078 17496 webserver.cc:460] Webserver started at http://127.0.0.1:42059/ using document root <none> and password file <none>
I20260810 03:17:32.960664 17496 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:32.960790 17496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:32.961067 17496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:32.963843 17496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b"
format_stamp: "Formatted at 2026-08-10 03:17:32 on dist-test-slave-jlzn"
server_key: "81cd4394b6bd0e45e851ad03a1b5a0fd"
server_key_iv: "120737cbe689819c28d2acb754cc4019"
server_key_version: "encryptionkey@0"
I20260810 03:17:32.964569 17496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b"
format_stamp: "Formatted at 2026-08-10 03:17:32 on dist-test-slave-jlzn"
server_key: "81cd4394b6bd0e45e851ad03a1b5a0fd"
server_key_iv: "120737cbe689819c28d2acb754cc4019"
server_key_version: "encryptionkey@0"
I20260810 03:17:32.969169 17496 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260810 03:17:32.972303 17519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:32.973454 17496 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:17:32.973610 17496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b"
format_stamp: "Formatted at 2026-08-10 03:17:32 on dist-test-slave-jlzn"
server_key: "81cd4394b6bd0e45e851ad03a1b5a0fd"
server_key_iv: "120737cbe689819c28d2acb754cc4019"
server_key_version: "encryptionkey@0"
I20260810 03:17:32.973783 17496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:32.991112 17496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:32.994985 17496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:32.995240 17496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:33.011940 17496 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40117
I20260810 03:17:33.011962 17611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40117 every 8 connection(s)
I20260810 03:17:33.013170 17496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:33.016501 17612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:33.022490 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 17496
I20260810 03:17:33.022682 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:33.023319 18881 external_mini_cluster.cc:1428] Setting key abe769be9c97246fc27b87298b9f8ad7
I20260810 03:17:33.026717 17612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b: Bootstrap starting.
I20260810 03:17:33.030391 17612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:33.031661 17612 log.cc:824] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:17:33 dist-test-slave-jlzn krb5kdc[17479](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:17:33.042516 17612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b: No bootstrap required, opened a new log
I20260810 03:17:33.050045 17615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:33.025045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57467 (local address 127.0.0.1:40117)
0810 03:17:33.025808 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:33.025822 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:33.025867 (+ 45us) server_negotiation.cc:407] Connection header received
0810 03:17:33.028259 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:33.028292 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:33.028762 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:33.029173 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:33.031057 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:33.033117 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:33.035060 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:33.036170 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:33.036363 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:33.041186 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:33.041193 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:33.041206 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:33.041239 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:33.044855 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:33.045821 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:33.045830 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:33.045842 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:33.046062 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:33.046602 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:33.046607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:33.046610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:33.047350 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:33.047685 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:33.048190 (+ 505us) server_negotiation.cc:299] Negotiation successful
0810 03:17:33.048740 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":322,"threads_started":1}
I20260810 03:17:33.051105 17612 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260810 03:17:33.051570 17612 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:33.051700 17612 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7c33a4d7b64dd9b79c3c25d17e423b, State: Initialized, Role: FOLLOWER
I20260810 03:17:33.052340 17612 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260810 03:17:33.052623 17612 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:33.052814 17612 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:33.052999 17612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:33.054436 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:33.055935 17612 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260810 03:17:33.056443 17612 leader_election.cc:302] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac7c33a4d7b64dd9b79c3c25d17e423b; no voters:
I20260810 03:17:33.057082 17612 leader_election.cc:288] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:33.057192 17618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:33.058384 17618 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [term 1 LEADER]: Becoming Leader. State: Replica: ac7c33a4d7b64dd9b79c3c25d17e423b, State: Running, Role: LEADER
I20260810 03:17:33.058967 17618 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260810 03:17:33.059321 17612 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:33.061599 17620 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac7c33a4d7b64dd9b79c3c25d17e423b. Latest consensus state: current_term: 1 leader_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } } }
I20260810 03:17:33.061951 17620 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:33.062520 17619 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7c33a4d7b64dd9b79c3c25d17e423b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } } }
I20260810 03:17:33.062820 17619 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:33.067662 17626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:33.086623 17626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:33.094471 17615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:33.073977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55505 (local address 127.0.0.1:40117)
0810 03:17:33.074117 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:33.074123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:33.074966 (+ 843us) server_negotiation.cc:407] Connection header received
0810 03:17:33.075150 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:33.075160 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:33.075242 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:33.075340 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:33.076992 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:33.078183 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:33.081278 (+ 3095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:33.081935 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:33.082034 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:33.087672 (+ 5638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:33.087678 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:33.087691 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:33.087729 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:33.091209 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:33.092171 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:33.092176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:33.092180 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:33.092334 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:33.092933 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:33.092938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:33.092941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:33.093291 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:33.093530 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:33.093970 (+ 440us) server_negotiation.cc:299] Negotiation successful
0810 03:17:33.094126 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 03:17:33.096812 17626 catalog_manager.cc:1347] Generated new cluster ID: 09d76d4083734b9ba29f6cf55aae6f2b
I20260810 03:17:33.096912 17626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:33.105048 17626 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:33.106220 17626 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:33.115687 17626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac7c33a4d7b64dd9b79c3c25d17e423b: Generated new TSK 0
I20260810 03:17:33.116390 17626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:33.124081 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17496
I20260810 03:17:33.127061 17606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:33.221287 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 17496
W20260810 03:17:33.245162 17476 connection.cc:535] client connection to 127.0.0.1:40117 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40117): Connection reset by peer (error 104)
2026-08-10T03:17:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2059 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:33 dist-test-slave-jlzn krb5kdc[17658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:33 dist-test-slave-jlzn krb5kdc[17658](info): set up 2 sockets
Aug 10 03:17:33 dist-test-slave-jlzn krb5kdc[17658](info): commencing operation
krb5kdc: starting...
W20260810 03:17:34.415155 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:34 dist-test-slave-jlzn krb5kdc[17658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:34.652714 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:34.971288 17676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:34.971568 17676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:34.971706 17676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:34.978574 17676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:34.978672 17676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:34.978751 17676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:34.978830 17676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:34.978889 17676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:34.988019 17676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34965
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:34.989076 17676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:34.990257 17676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:35.000927 17684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:35.000996 17688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:35.000964 17685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:35.001942 17676 server_base.cc:1034] running on GCE node
I20260810 03:17:35.002660 17676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:35.003873 17676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:35.005067 17676 hybrid_clock.cc:648] HybridClock initialized: now 1786331855005025 us; error 32 us; skew 500 ppm
I20260810 03:17:35.005373 17676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:35 dist-test-slave-jlzn krb5kdc[17658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331855, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:35.008237 17676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:35.009578 17676 webserver.cc:460] Webserver started at http://127.0.0.1:32921/ using document root <none> and password file <none>
I20260810 03:17:35.010136 17676 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:35.010232 17676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:35.010459 17676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:35.013164 17676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "953398dd5fe743aaab4696422cdf6f2b"
format_stamp: "Formatted at 2026-08-10 03:17:35 on dist-test-slave-jlzn"
server_key: "2b79afb05c13b534e82152b2eea4a8fe"
server_key_iv: "012f3fe626f19db5bf30bdd64fc3d820"
server_key_version: "encryptionkey@0"
I20260810 03:17:35.013846 17676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "953398dd5fe743aaab4696422cdf6f2b"
format_stamp: "Formatted at 2026-08-10 03:17:35 on dist-test-slave-jlzn"
server_key: "2b79afb05c13b534e82152b2eea4a8fe"
server_key_iv: "012f3fe626f19db5bf30bdd64fc3d820"
server_key_version: "encryptionkey@0"
I20260810 03:17:35.018399 17676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:35.021517 17699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:35.022667 17676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:17:35.022821 17676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "953398dd5fe743aaab4696422cdf6f2b"
format_stamp: "Formatted at 2026-08-10 03:17:35 on dist-test-slave-jlzn"
server_key: "2b79afb05c13b534e82152b2eea4a8fe"
server_key_iv: "012f3fe626f19db5bf30bdd64fc3d820"
server_key_version: "encryptionkey@0"
I20260810 03:17:35.022981 17676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:35.036415 17676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:35.039757 17676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:35.040035 17676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:35.056764 17676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34965
I20260810 03:17:35.056805 17785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34965 every 8 connection(s)
I20260810 03:17:35.057926 17676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:35.061216 17786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:35.062188 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 17676
I20260810 03:17:35.062381 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:35.062937 18881 external_mini_cluster.cc:1428] Setting key 0153859a76399f1ec20b7898c48e82d4
I20260810 03:17:35.073385 17786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b: Bootstrap starting.
I20260810 03:17:35.075676 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:35.064613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42853 (local address 127.0.0.1:34965)
0810 03:17:35.065349 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:35.065360 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:35.065397 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:17:35.067125 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:35.067146 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:35.067484 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:35.067832 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:35.068370 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:35.069564 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:35.070839 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:35.071829 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:35.071995 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:35.073319 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:35.073330 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:35.073346 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:35.073999 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:35.074094 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:35.074126 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:35.074278 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:35.074613 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 03:17:35.074773 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":327,"threads_started":1}
I20260810 03:17:35.076747 17786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:35.077793 17786 log.cc:824] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:35.079440 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:35.080551 17786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b: No bootstrap required, opened a new log
I20260810 03:17:35.088956 17786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260810 03:17:35.089331 17786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:35.089458 17786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 953398dd5fe743aaab4696422cdf6f2b, State: Initialized, Role: FOLLOWER
I20260810 03:17:35.089843 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:35.083385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48255 (local address 127.0.0.1:34965)
0810 03:17:35.083557 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:35.083564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:35.084102 (+ 538us) server_negotiation.cc:407] Connection header received
0810 03:17:35.084246 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:35.084249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:35.084313 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:35.084395 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:35.084911 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:35.085646 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:35.087468 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:35.087963 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:35.088054 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:35.089104 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:35.089109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:35.089112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:35.089137 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:35.089185 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:35.089200 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:35.089293 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:35.089508 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 03:17:35.089551 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:17:35.090106 17786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260810 03:17:35.090364 17786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:35.090518 17786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:35.090713 17786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:35.092810 17786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260810 03:17:35.093209 17786 leader_election.cc:302] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 953398dd5fe743aaab4696422cdf6f2b; no voters:
I20260810 03:17:35.093740 17786 leader_election.cc:288] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:35.093842 17801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:35.094764 17801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [term 1 LEADER]: Becoming Leader. State: Replica: 953398dd5fe743aaab4696422cdf6f2b, State: Running, Role: LEADER
I20260810 03:17:35.095276 17801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260810 03:17:35.095947 17786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:35.098172 17803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "953398dd5fe743aaab4696422cdf6f2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260810 03:17:35.098205 17804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 953398dd5fe743aaab4696422cdf6f2b. Latest consensus state: current_term: 1 leader_uuid: "953398dd5fe743aaab4696422cdf6f2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953398dd5fe743aaab4696422cdf6f2b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260810 03:17:35.098583 17803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:35.098583 17804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:35.100519 17810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:35.105443 17810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:35.113821 17810 catalog_manager.cc:1347] Generated new cluster ID: 6c8a32b94f2f4a5199a616503e461c2f
I20260810 03:17:35.113921 17810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:35.123950 17810 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:35.125535 17810 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:35.138135 17810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 953398dd5fe743aaab4696422cdf6f2b: Generated new TSK 0
I20260810 03:17:35.138944 17810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:35.147704 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17676
W20260810 03:17:35.148955 17779 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42853
W20260810 03:17:35.149600 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17676: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:35.149804 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 17676
W20260810 03:17:35.172433 17656 connection.cc:535] client connection to 127.0.0.1:34965 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34965): Connection reset by peer (error 104)
2026-08-10T03:17:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1927 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:35 dist-test-slave-jlzn krb5kdc[17831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:35 dist-test-slave-jlzn krb5kdc[17831](info): set up 2 sockets
Aug 10 03:17:35 dist-test-slave-jlzn krb5kdc[17831](info): commencing operation
krb5kdc: starting...
W20260810 03:17:36.338701 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.007s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:36 dist-test-slave-jlzn krb5kdc[17831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:36.578369 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:36.894882 17853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:36.895143 17853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:36.895231 17853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:36.902098 17853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:36.902191 17853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:36.902242 17853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:36.902300 17853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:36.902343 17853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:36.911870 17853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:36.912909 17853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:36.914047 17853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:36.924628 17860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:36.924708 17864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:36.924685 17861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:36.925705 17853 server_base.cc:1034] running on GCE node
I20260810 03:17:36.926384 17853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:36.927558 17853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:36.928756 17853 hybrid_clock.cc:648] HybridClock initialized: now 1786331856928701 us; error 49 us; skew 500 ppm
I20260810 03:17:36.929068 17853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:36 dist-test-slave-jlzn krb5kdc[17831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331856, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:36.934535 17853 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:36.935796 17853 webserver.cc:460] Webserver started at http://127.0.0.1:39627/ using document root <none> and password file <none>
I20260810 03:17:36.936414 17853 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:36.936530 17853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:36.936797 17853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:36.939505 17853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "a2fc71c066944c329d2cca2de1366a73"
format_stamp: "Formatted at 2026-08-10 03:17:36 on dist-test-slave-jlzn"
server_key: "4f964c71a8731eec8bed29e443c515e9"
server_key_iv: "650ca16ee8cc607533cb851728f29f05"
server_key_version: "encryptionkey@0"
I20260810 03:17:36.940240 17853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "a2fc71c066944c329d2cca2de1366a73"
format_stamp: "Formatted at 2026-08-10 03:17:36 on dist-test-slave-jlzn"
server_key: "4f964c71a8731eec8bed29e443c515e9"
server_key_iv: "650ca16ee8cc607533cb851728f29f05"
server_key_version: "encryptionkey@0"
I20260810 03:17:36.944841 17853 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:36.947889 17874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:36.949008 17853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:17:36.949164 17853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "a2fc71c066944c329d2cca2de1366a73"
format_stamp: "Formatted at 2026-08-10 03:17:36 on dist-test-slave-jlzn"
server_key: "4f964c71a8731eec8bed29e443c515e9"
server_key_iv: "650ca16ee8cc607533cb851728f29f05"
server_key_version: "encryptionkey@0"
I20260810 03:17:36.949338 17853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:36.954668 17853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:36.958209 17853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:36.958459 17853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:36.974517 17853 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46667
I20260810 03:17:36.974568 17969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46667 every 8 connection(s)
I20260810 03:17:36.975706 17853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:36.978951 17970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:36.979553 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 17853
I20260810 03:17:36.979736 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:36.980309 18881 external_mini_cluster.cc:1428] Setting key 65bc665b825934c6a1c703ce69ef3fc3
I20260810 03:17:36.987843 17974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:36.981904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41179 (local address 127.0.0.1:46667)
0810 03:17:36.982597 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:36.982607 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:36.982656 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:17:36.984815 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:36.984842 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:36.985154 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:36.985458 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:36.986473 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:36.986480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:36.986491 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:36.986505 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:36.986574 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:36.986597 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:36.986751 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:36.986853 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 03:17:36.986989 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":310,"threads_started":1}
I20260810 03:17:36.991056 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:36.991402 17970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73: Bootstrap starting.
I20260810 03:17:36.994930 17970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:36.996186 17970 log.cc:824] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:36.998428 17974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:36.996354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36241 (local address 127.0.0.1:46667)
0810 03:17:36.996484 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:36.996488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:36.996826 (+ 338us) server_negotiation.cc:407] Connection header received
0810 03:17:36.996963 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:36.996967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:36.997032 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:36.997142 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:36.997881 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:36.997885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:36.997889 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:36.997902 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:36.997936 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:36.997949 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:36.998035 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:36.998150 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 03:17:36.998187 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 03:17:36.999167 17970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73: No bootstrap required, opened a new log
I20260810 03:17:37.005863 17970 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } }
I20260810 03:17:37.006187 17970 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:37.006283 17970 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2fc71c066944c329d2cca2de1366a73, State: Initialized, Role: FOLLOWER
I20260810 03:17:37.006765 17970 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } }
I20260810 03:17:37.006976 17970 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:37.007112 17970 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:37.007259 17970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:37.009292 17970 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } }
I20260810 03:17:37.009725 17970 leader_election.cc:302] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2fc71c066944c329d2cca2de1366a73; no voters:
I20260810 03:17:37.010251 17970 leader_election.cc:288] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:37.010355 17983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:37.010964 17983 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [term 1 LEADER]: Becoming Leader. State: Replica: a2fc71c066944c329d2cca2de1366a73, State: Running, Role: LEADER
I20260810 03:17:37.011451 17983 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } }
I20260810 03:17:37.012161 17970 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:37.014235 17984 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2fc71c066944c329d2cca2de1366a73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } } }
I20260810 03:17:37.014605 17984 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:37.015271 17985 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2fc71c066944c329d2cca2de1366a73. Latest consensus state: current_term: 1 leader_uuid: "a2fc71c066944c329d2cca2de1366a73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2fc71c066944c329d2cca2de1366a73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46667 } } }
I20260810 03:17:37.015563 17985 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:37.019613 17989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:37.024103 17989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:37.032218 17989 catalog_manager.cc:1347] Generated new cluster ID: 4e7384fb2ce947a0920db5142c95e98a
I20260810 03:17:37.032316 17989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:37.056128 17989 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:37.056553 17989 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:37.078526 17989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2fc71c066944c329d2cca2de1366a73: Generated new TSK 0
I20260810 03:17:37.079420 17989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:37.096678 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17853
W20260810 03:17:37.097679 17964 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41179
W20260810 03:17:37.098273 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 17853: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:37.098417 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 17853
2026-08-10T03:17:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1951 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:37 dist-test-slave-jlzn krb5kdc[18011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:37 dist-test-slave-jlzn krb5kdc[18011](info): set up 2 sockets
Aug 10 03:17:37 dist-test-slave-jlzn krb5kdc[18011](info): commencing operation
krb5kdc: starting...
W20260810 03:17:38.290895 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:38 dist-test-slave-jlzn krb5kdc[18011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:38.530624 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:38.844748 18032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:38.845021 18032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:38.845155 18032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:38.852062 18032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:38.852171 18032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:38.852249 18032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:38.852326 18032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:38.852384 18032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:38.861644 18032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:38.862762 18032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:38.864269 18032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:38.876122 18046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:38.876081 18049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:38.876366 18043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:38.877154 18032 server_base.cc:1034] running on GCE node
I20260810 03:17:38.877844 18032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:38.879061 18032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:38.880247 18032 hybrid_clock.cc:648] HybridClock initialized: now 1786331858880195 us; error 42 us; skew 500 ppm
I20260810 03:17:38.880554 18032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:38 dist-test-slave-jlzn krb5kdc[18011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331858, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:38.883389 18032 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:38.884742 18032 webserver.cc:460] Webserver started at http://127.0.0.1:33247/ using document root <none> and password file <none>
I20260810 03:17:38.885340 18032 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:38.885457 18032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:38.885727 18032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:38.888607 18032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "0752f6d392664097ac8fbfdaaf168735"
format_stamp: "Formatted at 2026-08-10 03:17:38 on dist-test-slave-jlzn"
server_key: "e173150accbcb86e04916a34305fc8cc"
server_key_iv: "63292c87408f4959662c2947891f675b"
server_key_version: "encryptionkey@0"
I20260810 03:17:38.889338 18032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "0752f6d392664097ac8fbfdaaf168735"
format_stamp: "Formatted at 2026-08-10 03:17:38 on dist-test-slave-jlzn"
server_key: "e173150accbcb86e04916a34305fc8cc"
server_key_iv: "63292c87408f4959662c2947891f675b"
server_key_version: "encryptionkey@0"
I20260810 03:17:38.894083 18032 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:38.897256 18060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:38.898432 18032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:17:38.898584 18032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "0752f6d392664097ac8fbfdaaf168735"
format_stamp: "Formatted at 2026-08-10 03:17:38 on dist-test-slave-jlzn"
server_key: "e173150accbcb86e04916a34305fc8cc"
server_key_iv: "63292c87408f4959662c2947891f675b"
server_key_version: "encryptionkey@0"
I20260810 03:17:38.898749 18032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:38.917810 18032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:38.921422 18032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:38.921659 18032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:38.938218 18032 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37089
I20260810 03:17:38.938257 18132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37089 every 8 connection(s)
I20260810 03:17:38.939407 18032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:38.941231 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18032
I20260810 03:17:38.941412 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:38.941959 18881 external_mini_cluster.cc:1428] Setting key cb593f20e69692442ebb401e1a75e2e6
I20260810 03:17:38.943404 18133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 03:17:38 dist-test-slave-jlzn krb5kdc[18011](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:17:38.956198 18133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735: Bootstrap starting.
I20260810 03:17:38.959254 18133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:38.960424 18133 log.cc:824] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:38.963382 18133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735: No bootstrap required, opened a new log
I20260810 03:17:38.963825 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:38.943542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38813 (local address 127.0.0.1:37089)
0810 03:17:38.944276 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:38.944286 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:38.944324 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:17:38.945866 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:38.945886 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:38.946239 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:38.946531 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:38.948303 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:38.949616 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:38.951292 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:38.951966 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:38.952086 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:38.956792 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:38.956803 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:38.956820 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:38.956861 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:38.959725 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:38.960525 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:38.960534 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:38.960541 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:38.960728 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:38.961219 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:38.961225 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:38.961228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:38.961855 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:38.962055 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:38.962514 (+ 459us) server_negotiation.cc:299] Negotiation successful
0810 03:17:38.962807 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":335,"threads_started":1}
I20260810 03:17:38.967145 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:38.972378 18133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } }
I20260810 03:17:38.972710 18133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:38.972812 18133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0752f6d392664097ac8fbfdaaf168735, State: Initialized, Role: FOLLOWER
I20260810 03:17:38.973376 18133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } }
I20260810 03:17:38.973587 18133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:38.973712 18133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:38.973858 18133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:38.976506 18133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } }
I20260810 03:17:38.976964 18133 leader_election.cc:302] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0752f6d392664097ac8fbfdaaf168735; no voters:
I20260810 03:17:38.977547 18133 leader_election.cc:288] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:38.977644 18152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:38.980417 18152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [term 1 LEADER]: Becoming Leader. State: Replica: 0752f6d392664097ac8fbfdaaf168735, State: Running, Role: LEADER
I20260810 03:17:38.981026 18152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } }
I20260810 03:17:38.981326 18133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:38.983788 18153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0752f6d392664097ac8fbfdaaf168735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } } }
I20260810 03:17:38.983866 18154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0752f6d392664097ac8fbfdaaf168735. Latest consensus state: current_term: 1 leader_uuid: "0752f6d392664097ac8fbfdaaf168735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0752f6d392664097ac8fbfdaaf168735" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37089 } } }
I20260810 03:17:38.984196 18153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:38.984194 18154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:38.985322 18157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:38.986306 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:38.972063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33091 (local address 127.0.0.1:37089)
0810 03:17:38.972233 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:38.972239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:38.972654 (+ 415us) server_negotiation.cc:407] Connection header received
0810 03:17:38.972810 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:38.972816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:38.972893 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:38.972995 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:38.974451 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:38.975582 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:38.976774 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:38.977247 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:38.977357 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:38.979584 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:38.979590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:38.979594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:38.979646 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:38.982626 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:38.983432 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:38.983438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:38.983441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:38.983664 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:38.984164 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:38.984170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:38.984173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:38.984540 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:38.984892 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:38.985759 (+ 867us) server_negotiation.cc:299] Negotiation successful
0810 03:17:38.985952 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:17:38.994230 18157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:39.003068 18157 catalog_manager.cc:1347] Generated new cluster ID: 6a9851bf85154a52a313137f5e23a224
I20260810 03:17:39.003196 18157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:39.013278 18157 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:39.014405 18157 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:39.019795 18157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0752f6d392664097ac8fbfdaaf168735: Generated new TSK 0
I20260810 03:17:39.020447 18157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:39.025336 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18032
I20260810 03:17:39.026278 18125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:39.112855 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18032
2026-08-10T03:17:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2008 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:39 dist-test-slave-jlzn krb5kdc[18182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:39 dist-test-slave-jlzn krb5kdc[18182](info): set up 2 sockets
Aug 10 03:17:39 dist-test-slave-jlzn krb5kdc[18182](info): commencing operation
krb5kdc: starting...
W20260810 03:17:40.303174 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:40 dist-test-slave-jlzn krb5kdc[18182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:40.544772 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:40.858965 18202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:40.859218 18202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:40.859329 18202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:40.867658 18202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:40.867784 18202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:40.867892 18202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:40.868019 18202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:40.868085 18202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:40.878479 18202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:40.879524 18202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:40.880765 18202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:40.891659 18209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:40.891716 18211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:40.891701 18208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:40.892807 18202 server_base.cc:1034] running on GCE node
I20260810 03:17:40.893517 18202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:40.894768 18202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:40.895977 18202 hybrid_clock.cc:648] HybridClock initialized: now 1786331860895927 us; error 42 us; skew 500 ppm
I20260810 03:17:40.896296 18202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:40 dist-test-slave-jlzn krb5kdc[18182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331860, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:40.899209 18202 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:40.900537 18202 webserver.cc:460] Webserver started at http://127.0.0.1:44555/ using document root <none> and password file <none>
I20260810 03:17:40.901126 18202 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:40.901226 18202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:40.901460 18202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:40.904433 18202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "46b67746f6f44a5f88b4ba2ff77d56df"
format_stamp: "Formatted at 2026-08-10 03:17:40 on dist-test-slave-jlzn"
server_key: "c2fb70986daee1a5dbd4aa12d0528253"
server_key_iv: "e772d797e137ff62acb2118231fd575d"
server_key_version: "encryptionkey@0"
I20260810 03:17:40.905161 18202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "46b67746f6f44a5f88b4ba2ff77d56df"
format_stamp: "Formatted at 2026-08-10 03:17:40 on dist-test-slave-jlzn"
server_key: "c2fb70986daee1a5dbd4aa12d0528253"
server_key_iv: "e772d797e137ff62acb2118231fd575d"
server_key_version: "encryptionkey@0"
I20260810 03:17:40.909938 18202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:40.913239 18219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:40.914467 18202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:17:40.914604 18202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "46b67746f6f44a5f88b4ba2ff77d56df"
format_stamp: "Formatted at 2026-08-10 03:17:40 on dist-test-slave-jlzn"
server_key: "c2fb70986daee1a5dbd4aa12d0528253"
server_key_iv: "e772d797e137ff62acb2118231fd575d"
server_key_version: "encryptionkey@0"
I20260810 03:17:40.914763 18202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:40.935936 18202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:40.939411 18202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:40.939636 18202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:40.956292 18202 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43927
I20260810 03:17:40.956348 18300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43927 every 8 connection(s)
I20260810 03:17:40.957491 18202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:40.960907 18301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:40.965004 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18202
I20260810 03:17:40.965194 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:40.965710 18881 external_mini_cluster.cc:1428] Setting key e8d15ab24784cb8ff1fe8038fa78a879
I20260810 03:17:40.971592 18301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df: Bootstrap starting.
I20260810 03:17:40.974398 18301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:40.975369 18301 log.cc:824] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:40.977876 18301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df: No bootstrap required, opened a new log
I20260810 03:17:40.978183 18309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:40.967378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49703 (local address 127.0.0.1:43927)
0810 03:17:40.968089 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:40.968099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:40.968137 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:17:40.970291 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:40.970313 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:40.970690 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:40.971014 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:40.971547 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:40.972906 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:40.974188 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:40.974889 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:40.975053 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:40.976113 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:40.976124 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:40.976137 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:40.976639 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:40.976708 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:40.976732 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:40.976837 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:40.977043 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 03:17:40.977287 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":325,"threads_started":1}
I20260810 03:17:40.981487 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:40.985088 18301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260810 03:17:40.985435 18301 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:40.985534 18301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b67746f6f44a5f88b4ba2ff77d56df, State: Initialized, Role: FOLLOWER
I20260810 03:17:40.986152 18301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260810 03:17:40.986443 18301 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:40.986599 18301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:40.986778 18301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:40.989041 18301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260810 03:17:40.989494 18301 leader_election.cc:302] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46b67746f6f44a5f88b4ba2ff77d56df; no voters:
I20260810 03:17:40.990061 18301 leader_election.cc:288] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:40.990172 18318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:40.991583 18309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:40.985473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38121 (local address 127.0.0.1:43927)
0810 03:17:40.985644 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:40.985649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:40.986193 (+ 544us) server_negotiation.cc:407] Connection header received
0810 03:17:40.986360 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:40.986363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:40.986426 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:40.986515 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:40.987092 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:40.987787 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:40.989106 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:40.989619 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:40.989736 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:40.990844 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:40.990850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:40.990854 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:40.990873 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:40.990935 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:40.990955 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:40.991016 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:40.991226 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 03:17:40.991299 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:17:40.992280 18301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:40.992404 18318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [term 1 LEADER]: Becoming Leader. State: Replica: 46b67746f6f44a5f88b4ba2ff77d56df, State: Running, Role: LEADER
I20260810 03:17:40.992982 18318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260810 03:17:40.995890 18322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } } }
I20260810 03:17:40.996315 18322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:40.996750 18323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46b67746f6f44a5f88b4ba2ff77d56df. Latest consensus state: current_term: 1 leader_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46b67746f6f44a5f88b4ba2ff77d56df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } } }
I20260810 03:17:40.997037 18323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:40.998718 18338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:41.002446 18338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:41.010068 18338 catalog_manager.cc:1347] Generated new cluster ID: 02fa53dc50464247af33da9802cf69b3
I20260810 03:17:41.010167 18338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:41.019706 18338 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:41.021005 18338 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:41.036409 18338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46b67746f6f44a5f88b4ba2ff77d56df: Generated new TSK 0
I20260810 03:17:41.037212 18338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:41.050604 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18202
W20260810 03:17:41.052165 18296 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49703
W20260810 03:17:41.052733 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18202: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:41.052879 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18202
2026-08-10T03:17:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1948 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:41 dist-test-slave-jlzn krb5kdc[18350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:41 dist-test-slave-jlzn krb5kdc[18350](info): set up 2 sockets
Aug 10 03:17:41 dist-test-slave-jlzn krb5kdc[18350](info): commencing operation
krb5kdc: starting...
W20260810 03:17:42.261473 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:42 dist-test-slave-jlzn krb5kdc[18350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:42.506915 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41791
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:42.821024 18369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:42.821297 18369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:42.821429 18369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:42.828409 18369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:42.828522 18369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:42.828603 18369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:42.828686 18369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:42.828744 18369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:42.838063 18369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:42.839205 18369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:42.840435 18369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:42.851204 18375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:42.851293 18380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:42.851199 18378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:42.852145 18369 server_base.cc:1034] running on GCE node
I20260810 03:17:42.852823 18369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:42.854024 18369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:42.855206 18369 hybrid_clock.cc:648] HybridClock initialized: now 1786331862855149 us; error 49 us; skew 500 ppm
I20260810 03:17:42.855515 18369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:42 dist-test-slave-jlzn krb5kdc[18350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331862, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:42.861392 18369 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:42.862665 18369 webserver.cc:460] Webserver started at http://127.0.0.1:40071/ using document root <none> and password file <none>
I20260810 03:17:42.863327 18369 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:42.863468 18369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:42.863792 18369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:42.867748 18369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "314a01627b4e4989b3203d8d933a9793"
format_stamp: "Formatted at 2026-08-10 03:17:42 on dist-test-slave-jlzn"
server_key: "bbb8ed026f92c80fb2282ea0eaa6d644"
server_key_iv: "350b70249adb8a476e8099ccd6b65562"
server_key_version: "encryptionkey@0"
I20260810 03:17:42.868691 18369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "314a01627b4e4989b3203d8d933a9793"
format_stamp: "Formatted at 2026-08-10 03:17:42 on dist-test-slave-jlzn"
server_key: "bbb8ed026f92c80fb2282ea0eaa6d644"
server_key_iv: "350b70249adb8a476e8099ccd6b65562"
server_key_version: "encryptionkey@0"
I20260810 03:17:42.874558 18369 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:17:42.877807 18391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:42.879030 18369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:17:42.879197 18369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "314a01627b4e4989b3203d8d933a9793"
format_stamp: "Formatted at 2026-08-10 03:17:42 on dist-test-slave-jlzn"
server_key: "bbb8ed026f92c80fb2282ea0eaa6d644"
server_key_iv: "350b70249adb8a476e8099ccd6b65562"
server_key_version: "encryptionkey@0"
I20260810 03:17:42.879364 18369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:42.884573 18369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:42.888078 18369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:42.888355 18369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:42.904853 18369 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41791
I20260810 03:17:42.904896 18476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41791 every 8 connection(s)
I20260810 03:17:42.906021 18369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:42.907182 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18369
I20260810 03:17:42.907375 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:42.907972 18881 external_mini_cluster.cc:1428] Setting key 9192c72845b8e2259802048ac08cfc6e
I20260810 03:17:42.910240 18477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:42.916090 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:42.909554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33229 (local address 127.0.0.1:41791)
0810 03:17:42.910301 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:42.910315 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:42.910361 (+ 46us) server_negotiation.cc:407] Connection header received
0810 03:17:42.912542 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:42.912568 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:42.912960 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:42.913377 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:42.914283 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:42.914290 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:42.914306 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:42.914327 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:42.914420 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:42.914447 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:42.914661 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:42.914780 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:17:42.914956 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":298,"threads_started":1}
I20260810 03:17:42.919305 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:42.923082 18477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793: Bootstrap starting.
I20260810 03:17:42.926340 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:42.924165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55401 (local address 127.0.0.1:41791)
0810 03:17:42.924322 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:42.924327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:42.924759 (+ 432us) server_negotiation.cc:407] Connection header received
0810 03:17:42.924871 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:42.924875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:42.924930 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:42.925031 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:42.925795 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:42.925800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:42.925804 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:42.925820 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:42.925866 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:42.925886 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:42.925992 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:42.926034 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 03:17:42.926080 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:17:42.926504 18477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:42.927506 18477 log.cc:824] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:42.929863 18477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793: No bootstrap required, opened a new log
I20260810 03:17:42.936579 18477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260810 03:17:42.936894 18477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:42.936981 18477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314a01627b4e4989b3203d8d933a9793, State: Initialized, Role: FOLLOWER
I20260810 03:17:42.937458 18477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260810 03:17:42.937675 18477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:42.937798 18477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:42.937949 18477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:42.939939 18477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260810 03:17:42.940371 18477 leader_election.cc:302] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314a01627b4e4989b3203d8d933a9793; no voters:
I20260810 03:17:42.940850 18477 leader_election.cc:288] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:42.940960 18502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:42.941589 18502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [term 1 LEADER]: Becoming Leader. State: Replica: 314a01627b4e4989b3203d8d933a9793, State: Running, Role: LEADER
I20260810 03:17:42.942066 18502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260810 03:17:42.942611 18477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:42.944542 18506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314a01627b4e4989b3203d8d933a9793. Latest consensus state: current_term: 1 leader_uuid: "314a01627b4e4989b3203d8d933a9793" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } } }
I20260810 03:17:42.944962 18506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:42.945643 18505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "314a01627b4e4989b3203d8d933a9793" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314a01627b4e4989b3203d8d933a9793" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } } }
I20260810 03:17:42.945959 18505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:42.947271 18515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:42.952396 18515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:42.960805 18515 catalog_manager.cc:1347] Generated new cluster ID: 3eade182bbfd494abc6d75a5865507ef
I20260810 03:17:42.960903 18515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:42.974982 18515 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:42.975409 18515 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:42.983248 18515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 314a01627b4e4989b3203d8d933a9793: Generated new TSK 0
I20260810 03:17:42.983937 18515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:42.993002 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18369
W20260810 03:17:42.993999 18470 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33229
W20260810 03:17:42.994588 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18369: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:42.994743 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18369
2026-08-10T03:17:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1940 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:43 dist-test-slave-jlzn krb5kdc[18537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:43 dist-test-slave-jlzn krb5kdc[18537](info): set up 2 sockets
Aug 10 03:17:43 dist-test-slave-jlzn krb5kdc[18537](info): commencing operation
krb5kdc: starting...
W20260810 03:17:44.191476 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:44 dist-test-slave-jlzn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:44.432519 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44839
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:44.745864 18562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:44.746131 18562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:44.746279 18562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:44.753278 18562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:44.753397 18562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:44.753475 18562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:44.753567 18562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:44.753628 18562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:44.762971 18562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:44.764139 18562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:44.765328 18562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:44.776089 18579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:44.776206 18576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:44.776582 18575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:44.777045 18562 server_base.cc:1034] running on GCE node
I20260810 03:17:44.777810 18562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:44.779026 18562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:44.780225 18562 hybrid_clock.cc:648] HybridClock initialized: now 1786331864780179 us; error 35 us; skew 500 ppm
I20260810 03:17:44.780545 18562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:44 dist-test-slave-jlzn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331864, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:44.783416 18562 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:44.784777 18562 webserver.cc:460] Webserver started at http://127.0.0.1:42727/ using document root <none> and password file <none>
I20260810 03:17:44.785356 18562 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:44.785475 18562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:44.785758 18562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:44.788538 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "90ccfea7ba4d47c3861f24f821691271"
format_stamp: "Formatted at 2026-08-10 03:17:44 on dist-test-slave-jlzn"
server_key: "5c20543bc5e9d5f8df04bf1308aed978"
server_key_iv: "9a55357227b0c2d3cd85204522ad9b22"
server_key_version: "encryptionkey@0"
I20260810 03:17:44.789245 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "90ccfea7ba4d47c3861f24f821691271"
format_stamp: "Formatted at 2026-08-10 03:17:44 on dist-test-slave-jlzn"
server_key: "5c20543bc5e9d5f8df04bf1308aed978"
server_key_iv: "9a55357227b0c2d3cd85204522ad9b22"
server_key_version: "encryptionkey@0"
I20260810 03:17:44.794049 18562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:17:44.797207 18587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:44.798365 18562 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 03:17:44.798520 18562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "90ccfea7ba4d47c3861f24f821691271"
format_stamp: "Formatted at 2026-08-10 03:17:44 on dist-test-slave-jlzn"
server_key: "5c20543bc5e9d5f8df04bf1308aed978"
server_key_iv: "9a55357227b0c2d3cd85204522ad9b22"
server_key_version: "encryptionkey@0"
I20260810 03:17:44.798694 18562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:44.822146 18562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:44.828404 18562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:44.828650 18562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:44.843995 18562 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44839
I20260810 03:17:44.844033 18680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44839 every 8 connection(s)
I20260810 03:17:44.845180 18562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:44.848541 18681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:44.851706 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18562
I20260810 03:17:44.851886 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:44.852303 18881 external_mini_cluster.cc:1428] Setting key 760a7e11efc3ffd2f52e95392284f352
I20260810 03:17:44.860707 18681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: Bootstrap starting.
I20260810 03:17:44.864034 18681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:44.865270 18681 log.cc:824] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:17:44 dist-test-slave-jlzn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:17:44.868460 18681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: No bootstrap required, opened a new log
I20260810 03:17:44.876855 18684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:44.853938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:51287 (local address 127.0.0.1:44839)
0810 03:17:44.854702 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:44.854716 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:44.854763 (+ 47us) server_negotiation.cc:407] Connection header received
0810 03:17:44.856725 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:44.856757 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:44.857243 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:44.857653 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:44.858997 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:44.860905 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:44.862164 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:44.863124 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:44.863322 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:44.868226 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:44.868237 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:44.868253 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:44.868294 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:44.872333 (+ 4039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:44.873310 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:44.873319 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:44.873326 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:44.873540 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:44.873981 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:44.873987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:44.873990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:44.874631 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:44.874957 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:44.875249 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 03:17:44.875565 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":315,"threads_started":1}
I20260810 03:17:44.878772 18681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } }
I20260810 03:17:44.879156 18681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:44.879274 18681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ccfea7ba4d47c3861f24f821691271, State: Initialized, Role: FOLLOWER
I20260810 03:17:44.879838 18681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } }
I20260810 03:17:44.880133 18681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:44.880292 18681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:44.880457 18681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:44.880524 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:44.882450 18681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } }
I20260810 03:17:44.882907 18681 leader_election.cc:302] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90ccfea7ba4d47c3861f24f821691271; no voters:
I20260810 03:17:44.883534 18681 leader_election.cc:288] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:44.883616 18693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:44.885663 18681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:44.897471 18693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [term 1 LEADER]: Becoming Leader. State: Replica: 90ccfea7ba4d47c3861f24f821691271, State: Running, Role: LEADER
I20260810 03:17:44.898113 18693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } }
I20260810 03:17:44.901901 18696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90ccfea7ba4d47c3861f24f821691271. Latest consensus state: current_term: 1 leader_uuid: "90ccfea7ba4d47c3861f24f821691271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } } }
I20260810 03:17:44.902446 18696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:44.903985 18698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90ccfea7ba4d47c3861f24f821691271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccfea7ba4d47c3861f24f821691271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44839 } } }
I20260810 03:17:44.904364 18698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271 [sys.catalog]: This master's current role is: LEADER
W20260810 03:17:44.906144 18714 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:17:44.906273 18714 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:17:44.906405 18716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:44.908175 18716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:44.910650 18684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:44.884730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:50693 (local address 127.0.0.1:44839)
0810 03:17:44.884901 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:44.884907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:44.895296 (+ 10389us) server_negotiation.cc:407] Connection header received
0810 03:17:44.895667 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:44.895673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:44.895750 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:44.895848 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:44.897272 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:44.898147 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:44.899687 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:44.900368 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:44.900517 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:44.904685 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:44.904692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:44.904696 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:44.904732 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:44.907886 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:44.908640 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:44.908646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:44.908650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:44.908772 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:44.909220 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:44.909225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:44.909229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:44.909547 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:44.909809 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:44.910183 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 03:17:44.910350 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:17:44.916296 18716 catalog_manager.cc:1347] Generated new cluster ID: 8cc40b6abe69474d8cfd107bdd4b2260
I20260810 03:17:44.916391 18716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:44.945299 18716 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:44.946395 18716 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:44.958313 18716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90ccfea7ba4d47c3861f24f821691271: Generated new TSK 0
I20260810 03:17:44.959007 18716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:44.966697 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18562
I20260810 03:17:44.968106 18673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:45.056623 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18562
W20260810 03:17:45.077652 18532 connection.cc:535] client connection to 127.0.0.1:44839 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44839): Connection reset by peer (error 104)
2026-08-10T03:17:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2056 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:45 dist-test-slave-jlzn krb5kdc[18725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:45 dist-test-slave-jlzn krb5kdc[18725](info): set up 2 sockets
Aug 10 03:17:45 dist-test-slave-jlzn krb5kdc[18725](info): commencing operation
krb5kdc: starting...
W20260810 03:17:46.249783 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:46 dist-test-slave-jlzn krb5kdc[18725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:46.488983 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40739
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:46.804162 18752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:46.804421 18752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:46.804559 18752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:46.811486 18752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:46.811614 18752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:46.811700 18752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:46.811784 18752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:46.811861 18752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:46.821079 18752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:46.822221 18752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:46.823467 18752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:46.834403 18761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:46.834455 18766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:46.834478 18757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:46.835426 18752 server_base.cc:1034] running on GCE node
I20260810 03:17:46.836203 18752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:46.837462 18752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:46.838668 18752 hybrid_clock.cc:648] HybridClock initialized: now 1786331866838626 us; error 37 us; skew 500 ppm
I20260810 03:17:46.838984 18752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:46 dist-test-slave-jlzn krb5kdc[18725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331866, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:46.841955 18752 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:46.843308 18752 webserver.cc:460] Webserver started at http://127.0.0.1:46541/ using document root <none> and password file <none>
I20260810 03:17:46.843945 18752 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:46.844069 18752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:46.844347 18752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:46.847173 18752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "c227a1cf5bca4d9bb160d83523268669"
format_stamp: "Formatted at 2026-08-10 03:17:46 on dist-test-slave-jlzn"
server_key: "e149c455ad7dc06684d70a9c72b88c86"
server_key_iv: "b280ac07b3b395f9b07f6f0cc73dbdb5"
server_key_version: "encryptionkey@0"
I20260810 03:17:46.847955 18752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "c227a1cf5bca4d9bb160d83523268669"
format_stamp: "Formatted at 2026-08-10 03:17:46 on dist-test-slave-jlzn"
server_key: "e149c455ad7dc06684d70a9c72b88c86"
server_key_iv: "b280ac07b3b395f9b07f6f0cc73dbdb5"
server_key_version: "encryptionkey@0"
I20260810 03:17:46.852698 18752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:17:46.855949 18776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:46.857133 18752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:17:46.857287 18752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "c227a1cf5bca4d9bb160d83523268669"
format_stamp: "Formatted at 2026-08-10 03:17:46 on dist-test-slave-jlzn"
server_key: "e149c455ad7dc06684d70a9c72b88c86"
server_key_iv: "b280ac07b3b395f9b07f6f0cc73dbdb5"
server_key_version: "encryptionkey@0"
I20260810 03:17:46.857453 18752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:46.872880 18752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:46.876714 18752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:46.876951 18752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:46.893944 18752 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40739
I20260810 03:17:46.893989 18850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40739 every 8 connection(s)
I20260810 03:17:46.895161 18752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:46.898639 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18752
I20260810 03:17:46.898762 18851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:46.898836 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:46.899399 18881 external_mini_cluster.cc:1428] Setting key cb63ee7f8757ea4caefd20b65892a6ac
I20260810 03:17:46.911978 18851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669: Bootstrap starting.
I20260810 03:17:46.912341 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:46.901243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:38417 (local address 127.0.0.1:40739)
0810 03:17:46.902188 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:46.902198 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:46.902237 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:17:46.903732 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:46.903751 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:46.904155 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:46.904461 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:46.905048 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:46.906344 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:46.908247 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:46.908910 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:46.909035 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:46.910234 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:46.910241 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:46.910253 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:46.910735 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:46.910805 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:46.910828 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:46.910936 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:46.911197 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 03:17:46.911347 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":409,"threads_started":1}
I20260810 03:17:46.914959 18851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:46.915762 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:46.916172 18851 log.cc:824] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:46.919104 18851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669: No bootstrap required, opened a new log
I20260810 03:17:46.926651 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:46.920361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:40783 (local address 127.0.0.1:40739)
0810 03:17:46.920522 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:46.920527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:46.921001 (+ 474us) server_negotiation.cc:407] Connection header received
0810 03:17:46.921120 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:46.921125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:46.921197 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:46.921303 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:46.921740 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:46.922857 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:46.924177 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:46.924859 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:46.924991 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:46.925961 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:46.925968 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:46.925972 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:46.925995 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:46.926039 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:46.926058 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:46.926188 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:46.926279 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 03:17:46.926329 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:17:46.928368 18851 raft_consensus.cc:348] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } }
I20260810 03:17:46.928684 18851 raft_consensus.cc:374] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:46.928777 18851 raft_consensus.cc:729] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c227a1cf5bca4d9bb160d83523268669, State: Initialized, Role: FOLLOWER
I20260810 03:17:46.929298 18851 consensus_queue.cc:260] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } }
I20260810 03:17:46.929517 18851 raft_consensus.cc:388] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:46.929643 18851 raft_consensus.cc:482] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:46.929781 18851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:46.932255 18851 raft_consensus.cc:504] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } }
I20260810 03:17:46.932686 18851 leader_election.cc:302] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c227a1cf5bca4d9bb160d83523268669; no voters:
I20260810 03:17:46.933154 18851 leader_election.cc:288] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:46.933279 18864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:46.934356 18864 raft_consensus.cc:686] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [term 1 LEADER]: Becoming Leader. State: Replica: c227a1cf5bca4d9bb160d83523268669, State: Running, Role: LEADER
I20260810 03:17:46.934827 18864 consensus_queue.cc:237] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } }
I20260810 03:17:46.935122 18851 sys_catalog.cc:564] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:46.937292 18868 sys_catalog.cc:455] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c227a1cf5bca4d9bb160d83523268669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } } }
I20260810 03:17:46.937835 18868 sys_catalog.cc:458] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:46.937266 18873 sys_catalog.cc:455] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c227a1cf5bca4d9bb160d83523268669. Latest consensus state: current_term: 1 leader_uuid: "c227a1cf5bca4d9bb160d83523268669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c227a1cf5bca4d9bb160d83523268669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40739 } } }
I20260810 03:17:46.938239 18873 sys_catalog.cc:458] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:46.938835 18879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:46.944825 18879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:46.953330 18879 catalog_manager.cc:1347] Generated new cluster ID: e7e5555477804b9faeffc5677e41345a
I20260810 03:17:46.953426 18879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:46.971031 18879 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:46.972234 18879 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:46.980463 18879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c227a1cf5bca4d9bb160d83523268669: Generated new TSK 0
I20260810 03:17:46.981097 18879 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:46.989768 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18752
W20260810 03:17:46.990952 18844 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.68:38417
W20260810 03:17:46.991602 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18752: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:46.991755 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18752
W20260810 03:17:47.013592 18722 connection.cc:535] client connection to 127.0.0.1:40739 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40739): Connection reset by peer (error 104)
2026-08-10T03:17:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1935 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:47 dist-test-slave-jlzn krb5kdc[18910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:47 dist-test-slave-jlzn krb5kdc[18910](info): set up 2 sockets
Aug 10 03:17:47 dist-test-slave-jlzn krb5kdc[18910](info): commencing operation
krb5kdc: starting...
W20260810 03:17:48.191998 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.002s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:48 dist-test-slave-jlzn krb5kdc[18910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:48.438768 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:48.753444 18934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:48.753710 18934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:48.753836 18934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:48.760628 18934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:48.760735 18934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:48.760810 18934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:48.760885 18934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:48.760942 18934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:48.770092 18934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:48.771159 18934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:48.772383 18934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:48.783229 18949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:48.783222 18942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:48.783224 18944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:48.784089 18934 server_base.cc:1034] running on GCE node
I20260810 03:17:48.784880 18934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:48.786079 18934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:48.787274 18934 hybrid_clock.cc:648] HybridClock initialized: now 1786331868787235 us; error 29 us; skew 500 ppm
I20260810 03:17:48.787560 18934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:48 dist-test-slave-jlzn krb5kdc[18910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331868, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:48.793895 18934 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:48.795203 18934 webserver.cc:460] Webserver started at http://127.0.0.1:44511/ using document root <none> and password file <none>
I20260810 03:17:48.795831 18934 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:48.796020 18934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:48.796355 18934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:48.799481 18934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "c052745cad8b494a84cdd51fd2e7fb45"
format_stamp: "Formatted at 2026-08-10 03:17:48 on dist-test-slave-jlzn"
server_key: "f41206a83518e79f182e5034af46db6d"
server_key_iv: "5da344bb2781b68784bd8a389e1a9be0"
server_key_version: "encryptionkey@0"
I20260810 03:17:48.800253 18934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "c052745cad8b494a84cdd51fd2e7fb45"
format_stamp: "Formatted at 2026-08-10 03:17:48 on dist-test-slave-jlzn"
server_key: "f41206a83518e79f182e5034af46db6d"
server_key_iv: "5da344bb2781b68784bd8a389e1a9be0"
server_key_version: "encryptionkey@0"
I20260810 03:17:48.805004 18934 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:17:48.808184 18958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:48.809360 18934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:48.809518 18934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "c052745cad8b494a84cdd51fd2e7fb45"
format_stamp: "Formatted at 2026-08-10 03:17:48 on dist-test-slave-jlzn"
server_key: "f41206a83518e79f182e5034af46db6d"
server_key_iv: "5da344bb2781b68784bd8a389e1a9be0"
server_key_version: "encryptionkey@0"
I20260810 03:17:48.809707 18934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:48.815068 18934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:48.818612 18934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:48.818871 18934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:48.837081 18934 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39103
I20260810 03:17:48.837136 19045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39103 every 8 connection(s)
I20260810 03:17:48.838313 18934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:48.838999 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 18934
I20260810 03:17:48.839195 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:48.839720 18881 external_mini_cluster.cc:1428] Setting key de382c821f32cdb532047a1e856cf147
I20260810 03:17:48.842334 19046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:48.846766 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:48.841364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:36073 (local address 127.0.0.1:39103)
0810 03:17:48.842082 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:48.842092 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:48.842130 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:17:48.843695 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:48.843715 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:48.844046 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:48.844378 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:48.845305 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:48.845310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:48.845322 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:48.845335 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:48.845406 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:48.845427 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:48.845635 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:48.845778 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 03:17:48.845941 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":302,"threads_started":1}
I20260810 03:17:48.850003 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:48.852670 19046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45: Bootstrap starting.
I20260810 03:17:48.855989 19046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:48.856560 19050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:48.854221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:39341 (local address 127.0.0.1:39103)
0810 03:17:48.854403 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:48.854408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:48.854745 (+ 337us) server_negotiation.cc:407] Connection header received
0810 03:17:48.854899 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:48.854903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:48.854944 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:48.855007 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:48.855927 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:48.855931 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:48.855934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:48.855948 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:48.855985 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:48.855999 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:48.856080 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:48.856257 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 03:17:48.856304 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:17:48.857165 19046 log.cc:824] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:48.859548 19046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45: No bootstrap required, opened a new log
I20260810 03:17:48.867662 19046 raft_consensus.cc:348] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } }
I20260810 03:17:48.868095 19046 raft_consensus.cc:374] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:48.868243 19046 raft_consensus.cc:729] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c052745cad8b494a84cdd51fd2e7fb45, State: Initialized, Role: FOLLOWER
I20260810 03:17:48.868852 19046 consensus_queue.cc:260] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } }
I20260810 03:17:48.869128 19046 raft_consensus.cc:388] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:48.869280 19046 raft_consensus.cc:482] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:48.869446 19046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:48.872126 19046 raft_consensus.cc:504] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } }
I20260810 03:17:48.872575 19046 leader_election.cc:302] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c052745cad8b494a84cdd51fd2e7fb45; no voters:
I20260810 03:17:48.873055 19046 leader_election.cc:288] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:48.873168 19062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:48.873754 19062 raft_consensus.cc:686] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [term 1 LEADER]: Becoming Leader. State: Replica: c052745cad8b494a84cdd51fd2e7fb45, State: Running, Role: LEADER
I20260810 03:17:48.874253 19062 consensus_queue.cc:237] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } }
I20260810 03:17:48.874828 19046 sys_catalog.cc:564] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:48.877094 19064 sys_catalog.cc:455] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c052745cad8b494a84cdd51fd2e7fb45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } } }
I20260810 03:17:48.877525 19067 sys_catalog.cc:455] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c052745cad8b494a84cdd51fd2e7fb45. Latest consensus state: current_term: 1 leader_uuid: "c052745cad8b494a84cdd51fd2e7fb45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c052745cad8b494a84cdd51fd2e7fb45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39103 } } }
I20260810 03:17:48.878188 19067 sys_catalog.cc:458] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:48.878070 19064 sys_catalog.cc:458] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:48.884692 19081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:48.889371 19081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:48.897325 19081 catalog_manager.cc:1347] Generated new cluster ID: 94b448fa1687477294eb86ef61b8baf8
I20260810 03:17:48.897426 19081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:48.937353 19081 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:48.937724 19081 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:48.949657 19081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c052745cad8b494a84cdd51fd2e7fb45: Generated new TSK 0
I20260810 03:17:48.950302 19081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:48.956869 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18934
W20260810 03:17:48.957798 19039 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.68:36073
W20260810 03:17:48.958460 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 18934: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:48.958587 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 18934
2026-08-10T03:17:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1968 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:49 dist-test-slave-jlzn krb5kdc[19101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:49 dist-test-slave-jlzn krb5kdc[19101](info): set up 2 sockets
Aug 10 03:17:49 dist-test-slave-jlzn krb5kdc[19101](info): commencing operation
krb5kdc: starting...
W20260810 03:17:50.149221 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:50 dist-test-slave-jlzn krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:50.402874 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:50.712194 19124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:50.712442 19124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:50.712565 19124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:50.719437 19124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:50.719537 19124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:50.719615 19124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:50.719704 19124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:50.719761 19124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:50.728909 19124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:50.729962 19124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:50.731141 19124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:50.741951 19131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:50.742031 19134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:50.741994 19132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:50.742856 19124 server_base.cc:1034] running on GCE node
I20260810 03:17:50.743544 19124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:50.744925 19124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:50.746129 19124 hybrid_clock.cc:648] HybridClock initialized: now 1786331870746089 us; error 29 us; skew 500 ppm
I20260810 03:17:50.746438 19124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:50 dist-test-slave-jlzn krb5kdc[19101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331870, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:50.749428 19124 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:50.750761 19124 webserver.cc:460] Webserver started at http://127.0.0.1:40499/ using document root <none> and password file <none>
I20260810 03:17:50.751360 19124 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:50.751478 19124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:50.751781 19124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:50.754488 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "04ac4223d0a1423586fcd253c81248dd"
format_stamp: "Formatted at 2026-08-10 03:17:50 on dist-test-slave-jlzn"
server_key: "1f94a48c8087770b4465422df7b3d560"
server_key_iv: "1445dcae4f9d44c1322c391740bb9a82"
server_key_version: "encryptionkey@0"
I20260810 03:17:50.755182 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "04ac4223d0a1423586fcd253c81248dd"
format_stamp: "Formatted at 2026-08-10 03:17:50 on dist-test-slave-jlzn"
server_key: "1f94a48c8087770b4465422df7b3d560"
server_key_iv: "1445dcae4f9d44c1322c391740bb9a82"
server_key_version: "encryptionkey@0"
I20260810 03:17:50.759850 19124 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:17:50.762948 19147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:50.764132 19124 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260810 03:17:50.764283 19124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "04ac4223d0a1423586fcd253c81248dd"
format_stamp: "Formatted at 2026-08-10 03:17:50 on dist-test-slave-jlzn"
server_key: "1f94a48c8087770b4465422df7b3d560"
server_key_iv: "1445dcae4f9d44c1322c391740bb9a82"
server_key_version: "encryptionkey@0"
I20260810 03:17:50.764447 19124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:50.774688 19124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:50.778486 19124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:50.778728 19124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:50.795488 19124 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39981
I20260810 03:17:50.795532 19217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39981 every 8 connection(s)
I20260810 03:17:50.796710 19124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:50.800165 19222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:50.801517 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19124
I20260810 03:17:50.801679 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:50.802088 18881 external_mini_cluster.cc:1428] Setting key 35be8ea6aaad5d216e4f6807dd99ff4a
I20260810 03:17:50.813128 19222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd: Bootstrap starting.
Aug 10 03:17:50 dist-test-slave-jlzn krb5kdc[19101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:17:50.816493 19222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:50.817490 19222 log.cc:824] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:50.820035 19222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd: No bootstrap required, opened a new log
I20260810 03:17:50.823640 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:50.803665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:46907 (local address 127.0.0.1:39981)
0810 03:17:50.804421 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:50.804431 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:50.804469 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:17:50.805999 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:50.806027 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:50.806390 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:50.806682 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:50.808444 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:50.809796 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:50.811505 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:50.812174 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:50.812294 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:50.816853 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:50.816861 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:50.816873 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:50.816917 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:50.819715 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:50.820496 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:50.820506 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:50.820511 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:50.820678 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:50.821133 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:50.821136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:50.821138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:50.821638 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:50.821950 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:50.822433 (+ 483us) server_negotiation.cc:299] Negotiation successful
0810 03:17:50.822707 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":565,"thread_start_us":365,"threads_started":1}
I20260810 03:17:50.827077 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:50.827551 19222 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260810 03:17:50.827888 19222 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:50.827982 19222 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04ac4223d0a1423586fcd253c81248dd, State: Initialized, Role: FOLLOWER
I20260810 03:17:50.828471 19222 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260810 03:17:50.828688 19222 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:50.828819 19222 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:50.828955 19222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:50.831293 19222 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260810 03:17:50.831879 19222 leader_election.cc:302] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04ac4223d0a1423586fcd253c81248dd; no voters:
I20260810 03:17:50.832481 19222 leader_election.cc:288] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:50.832612 19236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:50.833230 19236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [term 1 LEADER]: Becoming Leader. State: Replica: 04ac4223d0a1423586fcd253c81248dd, State: Running, Role: LEADER
I20260810 03:17:50.833832 19236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260810 03:17:50.835429 19236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ac4223d0a1423586fcd253c81248dd. Latest consensus state: current_term: 1 leader_uuid: "04ac4223d0a1423586fcd253c81248dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } } }
I20260810 03:17:50.835855 19236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:50.836199 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04ac4223d0a1423586fcd253c81248dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ac4223d0a1423586fcd253c81248dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } } }
I20260810 03:17:50.836511 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:50.840651 19222 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:50.847831 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:50.831232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:38721 (local address 127.0.0.1:39981)
0810 03:17:50.831360 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:50.831364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:50.831953 (+ 589us) server_negotiation.cc:407] Connection header received
0810 03:17:50.832114 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:50.832120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:50.832193 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:50.832307 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:50.834018 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:50.835241 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:50.837135 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:50.837836 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:50.837949 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:50.841024 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:50.841030 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:50.841035 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:50.841068 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:50.844628 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:50.845537 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:50.845543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:50.845546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:50.845716 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:50.846197 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:50.846202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:50.846206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:50.846621 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:50.846911 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:50.847255 (+ 344us) server_negotiation.cc:299] Negotiation successful
0810 03:17:50.847433 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:17:50.849426 19241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:50.854187 19241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:50.861776 19241 catalog_manager.cc:1347] Generated new cluster ID: 0f95c7dabac145d7a76731c219c09151
I20260810 03:17:50.861874 19241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:50.880956 19241 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:50.882066 19241 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:50.888615 19241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04ac4223d0a1423586fcd253c81248dd: Generated new TSK 0
I20260810 03:17:50.889259 19241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:50.899971 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19124
I20260810 03:17:50.901238 19211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:50.988845 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19124
W20260810 03:17:51.010268 19099 connection.cc:535] client connection to 127.0.0.1:39981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39981): Connection reset by peer (error 104)
2026-08-10T03:17:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2028 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:51 dist-test-slave-jlzn krb5kdc[19266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:51 dist-test-slave-jlzn krb5kdc[19266](info): set up 2 sockets
Aug 10 03:17:51 dist-test-slave-jlzn krb5kdc[19266](info): commencing operation
krb5kdc: starting...
W20260810 03:17:52.191556 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:52 dist-test-slave-jlzn krb5kdc[19266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:52.434859 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:52.749092 19287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:52.749347 19287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:52.749475 19287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:52.756333 19287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:52.756435 19287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:52.756515 19287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:52.756599 19287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:52.756667 19287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:52.765883 19287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38711
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:52.766980 19287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:52.768204 19287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:52.779050 19297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:52.779012 19293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:52.779095 19292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:52.780064 19287 server_base.cc:1034] running on GCE node
I20260810 03:17:52.780797 19287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:52.781983 19287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:52.783174 19287 hybrid_clock.cc:648] HybridClock initialized: now 1786331872783124 us; error 43 us; skew 500 ppm
I20260810 03:17:52.783488 19287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:52 dist-test-slave-jlzn krb5kdc[19266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331872, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:52.786410 19287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:52.787671 19287 webserver.cc:460] Webserver started at http://127.0.0.1:46769/ using document root <none> and password file <none>
I20260810 03:17:52.788295 19287 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:52.788398 19287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:52.788628 19287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:52.791381 19287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "02698fdd16b0453b9d64bc577d80607a"
format_stamp: "Formatted at 2026-08-10 03:17:52 on dist-test-slave-jlzn"
server_key: "a54e500f7e76bedfe5b4a36bd8df0685"
server_key_iv: "6224142efca7a2213f9a6f8f9d07ce15"
server_key_version: "encryptionkey@0"
I20260810 03:17:52.792311 19287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "02698fdd16b0453b9d64bc577d80607a"
format_stamp: "Formatted at 2026-08-10 03:17:52 on dist-test-slave-jlzn"
server_key: "a54e500f7e76bedfe5b4a36bd8df0685"
server_key_iv: "6224142efca7a2213f9a6f8f9d07ce15"
server_key_version: "encryptionkey@0"
I20260810 03:17:52.797158 19287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:52.800362 19307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:52.801553 19287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:52.801710 19287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "02698fdd16b0453b9d64bc577d80607a"
format_stamp: "Formatted at 2026-08-10 03:17:52 on dist-test-slave-jlzn"
server_key: "a54e500f7e76bedfe5b4a36bd8df0685"
server_key_iv: "6224142efca7a2213f9a6f8f9d07ce15"
server_key_version: "encryptionkey@0"
I20260810 03:17:52.801882 19287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:52.823187 19287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:52.826809 19287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:52.827059 19287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:52.843777 19287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38711
I20260810 03:17:52.843827 19382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38711 every 8 connection(s)
I20260810 03:17:52.845062 19287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:52.848438 19384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:52.854638 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19287
I20260810 03:17:52.854799 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:52.855219 18881 external_mini_cluster.cc:1428] Setting key 8f647a25545c94f5cf9e8941f2f52caf
I20260810 03:17:52.858325 19384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: Bootstrap starting.
I20260810 03:17:52.861459 19384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:52.862545 19384 log.cc:824] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:52.865624 19384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: No bootstrap required, opened a new log
I20260810 03:17:52.869077 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:52.856962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:55083 (local address 127.0.0.1:38711)
0810 03:17:52.857682 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:52.857693 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:52.857732 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:17:52.859393 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:52.859415 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:52.859766 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:52.860114 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:52.860640 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:52.861907 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:52.863740 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:52.864756 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:52.864947 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:52.866256 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:52.866267 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:52.866284 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:52.866952 (+ 668us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:52.867044 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:52.867078 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:52.867253 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:52.867647 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 03:17:52.867843 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":327,"threads_started":1}
I20260810 03:17:52.872639 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:52.874444 19384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } }
I20260810 03:17:52.874749 19384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:52.874845 19384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02698fdd16b0453b9d64bc577d80607a, State: Initialized, Role: FOLLOWER
I20260810 03:17:52.875392 19384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } }
I20260810 03:17:52.875672 19384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:52.875828 19384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:52.875995 19384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:52.878409 19384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } }
I20260810 03:17:52.878859 19384 leader_election.cc:302] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02698fdd16b0453b9d64bc577d80607a; no voters:
I20260810 03:17:52.879442 19384 leader_election.cc:288] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:52.879546 19398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:52.881538 19384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:52.882753 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:52.876716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:38653 (local address 127.0.0.1:38711)
0810 03:17:52.876897 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:52.876902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:52.877287 (+ 385us) server_negotiation.cc:407] Connection header received
0810 03:17:52.877447 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:52.877453 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:52.877518 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:52.877592 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:52.878119 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:52.878877 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:52.880378 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:52.880812 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:52.880915 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:52.881980 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:52.881985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:52.881991 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:52.882007 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:52.882084 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:52.882108 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:52.882208 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:52.882397 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 03:17:52.882443 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:17:52.886348 19398 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [term 1 LEADER]: Becoming Leader. State: Replica: 02698fdd16b0453b9d64bc577d80607a, State: Running, Role: LEADER
I20260810 03:17:52.886893 19398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } }
I20260810 03:17:52.891760 19399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02698fdd16b0453b9d64bc577d80607a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } } }
I20260810 03:17:52.892180 19399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:52.891732 19400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02698fdd16b0453b9d64bc577d80607a. Latest consensus state: current_term: 1 leader_uuid: "02698fdd16b0453b9d64bc577d80607a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02698fdd16b0453b9d64bc577d80607a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38711 } } }
I20260810 03:17:52.892462 19400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a [sys.catalog]: This master's current role is: LEADER
W20260810 03:17:52.897256 19415 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:17:52.897367 19415 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:17:52.897486 19416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:52.899539 19416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:52.907593 19416 catalog_manager.cc:1347] Generated new cluster ID: 77c01bd3a0d84c28bf1ab685cfadbeb3
I20260810 03:17:52.907709 19416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:52.925275 19416 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:52.926330 19416 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:52.933666 19416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02698fdd16b0453b9d64bc577d80607a: Generated new TSK 0
I20260810 03:17:52.934494 19416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:52.950506 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19287
W20260810 03:17:52.951545 19378 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.68:55083
W20260810 03:17:52.952279 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:52.952415 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19287
W20260810 03:17:52.977924 19263 connection.cc:535] client connection to 127.0.0.1:38711 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38711): Connection reset by peer (error 104)
2026-08-10T03:17:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1967 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:53 dist-test-slave-jlzn krb5kdc[19423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:53 dist-test-slave-jlzn krb5kdc[19423](info): set up 2 sockets
Aug 10 03:17:53 dist-test-slave-jlzn krb5kdc[19423](info): commencing operation
krb5kdc: starting...
W20260810 03:17:54.160616 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.009s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:54 dist-test-slave-jlzn krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:17:54.402343 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:54.718909 19444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:54.719185 19444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:54.719327 19444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:54.726312 19444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:54.726425 19444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:54.726512 19444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:54.726591 19444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:54.726648 19444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:54.736454 19444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:54.737627 19444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:54.738811 19444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:54.750170 19455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:54.750197 19460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:54.750126 19458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:54.750964 19444 server_base.cc:1034] running on GCE node
I20260810 03:17:54.751646 19444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:54.752914 19444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:54.754110 19444 hybrid_clock.cc:648] HybridClock initialized: now 1786331874754072 us; error 33 us; skew 500 ppm
I20260810 03:17:54.754402 19444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:54 dist-test-slave-jlzn krb5kdc[19423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331874, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:54.760785 19444 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:17:54.762116 19444 webserver.cc:460] Webserver started at http://127.0.0.1:37653/ using document root <none> and password file <none>
I20260810 03:17:54.762733 19444 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:54.762847 19444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:54.763150 19444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:54.765969 19444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "3c520051d2394bf783ee9511ed3f3a12"
format_stamp: "Formatted at 2026-08-10 03:17:54 on dist-test-slave-jlzn"
server_key: "85bdd4bf46a5b9c0984fa7f9b90a7f13"
server_key_iv: "b238ccc3c84a5e2122296a5b3488a700"
server_key_version: "encryptionkey@0"
I20260810 03:17:54.766700 19444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "3c520051d2394bf783ee9511ed3f3a12"
format_stamp: "Formatted at 2026-08-10 03:17:54 on dist-test-slave-jlzn"
server_key: "85bdd4bf46a5b9c0984fa7f9b90a7f13"
server_key_iv: "b238ccc3c84a5e2122296a5b3488a700"
server_key_version: "encryptionkey@0"
I20260810 03:17:54.771553 19444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 03:17:54.775174 19473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:54.776427 19444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:54.776590 19444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "3c520051d2394bf783ee9511ed3f3a12"
format_stamp: "Formatted at 2026-08-10 03:17:54 on dist-test-slave-jlzn"
server_key: "85bdd4bf46a5b9c0984fa7f9b90a7f13"
server_key_iv: "b238ccc3c84a5e2122296a5b3488a700"
server_key_version: "encryptionkey@0"
I20260810 03:17:54.776777 19444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:54.782102 19444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:54.786015 19444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:54.786285 19444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:54.803086 19444 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46239
I20260810 03:17:54.803136 19551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46239 every 8 connection(s)
I20260810 03:17:54.804421 19444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:54.807881 19552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:54.812980 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19444
I20260810 03:17:54.813143 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:54.813550 18881 external_mini_cluster.cc:1428] Setting key af97fe956c8f93eab2658dd393205539
I20260810 03:17:54.818636 19552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12: Bootstrap starting.
I20260810 03:17:54.820842 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:54.815207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:60617 (local address 127.0.0.1:46239)
0810 03:17:54.816045 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:54.816059 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:54.816103 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:17:54.817748 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:54.817770 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:54.818077 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:54.818377 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:54.819375 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:54.819380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:54.819391 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:54.819403 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:54.819452 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:54.819469 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:54.819623 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:54.819776 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 03:17:54.819987 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":353,"threads_started":1}
I20260810 03:17:54.821995 19552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:54.823045 19552 log.cc:824] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:54.824330 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:54.825681 19552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12: No bootstrap required, opened a new log
I20260810 03:17:54.830765 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:54.828462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:57519 (local address 127.0.0.1:46239)
0810 03:17:54.828653 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:54.828658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:54.828960 (+ 302us) server_negotiation.cc:407] Connection header received
0810 03:17:54.829111 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:54.829114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:54.829183 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:54.829259 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:54.830173 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:54.830177 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:54.830181 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:54.830195 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:54.830235 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:54.830250 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:54.830338 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:54.830446 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 03:17:54.830503 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:17:54.834022 19552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260810 03:17:54.834340 19552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:54.834436 19552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c520051d2394bf783ee9511ed3f3a12, State: Initialized, Role: FOLLOWER
I20260810 03:17:54.835031 19552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260810 03:17:54.835299 19552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:54.835429 19552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:54.835582 19552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:54.837630 19552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260810 03:17:54.838099 19552 leader_election.cc:302] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c520051d2394bf783ee9511ed3f3a12; no voters:
I20260810 03:17:54.838656 19552 leader_election.cc:288] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:54.838773 19568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:54.839360 19568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [term 1 LEADER]: Becoming Leader. State: Replica: 3c520051d2394bf783ee9511ed3f3a12, State: Running, Role: LEADER
I20260810 03:17:54.839874 19568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260810 03:17:54.840526 19552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:54.843523 19574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c520051d2394bf783ee9511ed3f3a12. Latest consensus state: current_term: 1 leader_uuid: "3c520051d2394bf783ee9511ed3f3a12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } } }
I20260810 03:17:54.843943 19574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:54.846690 19581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:54.850512 19570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c520051d2394bf783ee9511ed3f3a12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c520051d2394bf783ee9511ed3f3a12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } } }
I20260810 03:17:54.850867 19570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:54.854416 19581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:54.866367 19581 catalog_manager.cc:1347] Generated new cluster ID: cbbb2f99156045c7b7b1323f24dcbb41
I20260810 03:17:54.866470 19581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:54.889519 19581 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:54.890036 19581 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:54.900169 19581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c520051d2394bf783ee9511ed3f3a12: Generated new TSK 0
I20260810 03:17:54.901014 19581 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:54.912858 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19444
W20260810 03:17:54.913991 19543 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.68:60617
W20260810 03:17:54.914610 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19444: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:54.914752 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19444
2026-08-10T03:17:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1957 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:55 dist-test-slave-jlzn krb5kdc[19601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:55 dist-test-slave-jlzn krb5kdc[19601](info): set up 2 sockets
Aug 10 03:17:55 dist-test-slave-jlzn krb5kdc[19601](info): commencing operation
krb5kdc: starting...
W20260810 03:17:56.110612 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:56 dist-test-slave-jlzn krb5kdc[19601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:17:56.379051 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35263
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:38273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:56.696861 19620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:56.697117 19620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:56.697265 19620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:56.704562 19620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:56.704668 19620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:56.704744 19620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:56.704828 19620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:56.704890 19620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:56.714215 19620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:38273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:56.715348 19620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:56.716589 19620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:56.727425 19630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:56.727468 19631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:56.727939 19636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:56.728091 19620 server_base.cc:1034] running on GCE node
I20260810 03:17:56.728839 19620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:56.730118 19620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:56.731319 19620 hybrid_clock.cc:648] HybridClock initialized: now 1786331876731278 us; error 36 us; skew 500 ppm
I20260810 03:17:56.731678 19620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:56 dist-test-slave-jlzn krb5kdc[19601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331876, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:56.734593 19620 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:17:56.735920 19620 webserver.cc:460] Webserver started at http://127.18.112.126:39153/ using document root <none> and password file <none>
I20260810 03:17:56.736500 19620 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:56.736599 19620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:56.736848 19620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:56.739534 19620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "bed21d78645947b29b170507d2f04e82"
format_stamp: "Formatted at 2026-08-10 03:17:56 on dist-test-slave-jlzn"
server_key: "dfebc09e88bcb35bbceef8e6f1764ef6"
server_key_iv: "0531d7793ed8c22aeb0db0856f6e5fd5"
server_key_version: "encryptionkey@0"
I20260810 03:17:56.740294 19620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "bed21d78645947b29b170507d2f04e82"
format_stamp: "Formatted at 2026-08-10 03:17:56 on dist-test-slave-jlzn"
server_key: "dfebc09e88bcb35bbceef8e6f1764ef6"
server_key_iv: "0531d7793ed8c22aeb0db0856f6e5fd5"
server_key_version: "encryptionkey@0"
I20260810 03:17:56.744980 19620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:17:56.748070 19648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:56.749236 19620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:17:56.749394 19620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "bed21d78645947b29b170507d2f04e82"
format_stamp: "Formatted at 2026-08-10 03:17:56 on dist-test-slave-jlzn"
server_key: "dfebc09e88bcb35bbceef8e6f1764ef6"
server_key_iv: "0531d7793ed8c22aeb0db0856f6e5fd5"
server_key_version: "encryptionkey@0"
I20260810 03:17:56.749559 19620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:56.774573 19620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:56.778134 19620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:56.778388 19620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:56.794871 19620 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35263
I20260810 03:17:56.794890 19716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35263 every 8 connection(s)
I20260810 03:17:56.796162 19620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:56.799746 19718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:56.801457 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19620
I20260810 03:17:56.801640 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:56.802068 18881 external_mini_cluster.cc:1428] Setting key f5c1eab4a296997196c4d2ccdb5c64dc
I20260810 03:17:56.813444 19718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82: Bootstrap starting.
Aug 10 03:17:56 dist-test-slave-jlzn krb5kdc[19601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:17:56.816262 19718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:56.817448 19718 log.cc:824] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:56.820254 19718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82: No bootstrap required, opened a new log
I20260810 03:17:56.824163 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:56.803822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58929 (local address 127.18.112.126:35263)
0810 03:17:56.804636 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:56.804651 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:56.804704 (+ 53us) server_negotiation.cc:407] Connection header received
0810 03:17:56.806309 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:56.806335 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:56.806815 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:56.807237 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:56.808558 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:56.810559 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:56.811853 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:56.812827 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:56.813003 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:56.816814 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:56.816824 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:56.816841 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:56.816888 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:56.820069 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:56.820907 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:56.820913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:56.820919 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:56.821078 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:56.821516 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:56.821523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:56.821525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:56.822043 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:56.822351 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:56.822857 (+ 506us) server_negotiation.cc:299] Negotiation successful
0810 03:17:56.823158 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":568,"thread_start_us":339,"threads_started":1}
I20260810 03:17:56.828030 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:56.828464 19718 raft_consensus.cc:348] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } }
I20260810 03:17:56.828792 19718 raft_consensus.cc:374] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:56.828887 19718 raft_consensus.cc:729] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed21d78645947b29b170507d2f04e82, State: Initialized, Role: FOLLOWER
I20260810 03:17:56.829406 19718 consensus_queue.cc:260] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } }
I20260810 03:17:56.829624 19718 raft_consensus.cc:388] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:56.829759 19718 raft_consensus.cc:482] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:56.829905 19718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:56.832253 19718 raft_consensus.cc:504] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } }
I20260810 03:17:56.832839 19718 leader_election.cc:302] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bed21d78645947b29b170507d2f04e82; no voters:
I20260810 03:17:56.835386 19718 leader_election.cc:288] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:56.835486 19740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:56.837540 19718 sys_catalog.cc:564] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:56.837826 19740 raft_consensus.cc:686] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [term 1 LEADER]: Becoming Leader. State: Replica: bed21d78645947b29b170507d2f04e82, State: Running, Role: LEADER
I20260810 03:17:56.838433 19740 consensus_queue.cc:237] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } }
I20260810 03:17:56.841668 19746 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bed21d78645947b29b170507d2f04e82. Latest consensus state: current_term: 1 leader_uuid: "bed21d78645947b29b170507d2f04e82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } } }
I20260810 03:17:56.842063 19746 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:56.842705 19741 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bed21d78645947b29b170507d2f04e82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed21d78645947b29b170507d2f04e82" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35263 } } }
I20260810 03:17:56.843729 19741 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:56.846006 19755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:56.847991 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:56.832324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46821 (local address 127.18.112.126:35263)
0810 03:17:56.832512 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:56.832518 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:56.832941 (+ 423us) server_negotiation.cc:407] Connection header received
0810 03:17:56.833107 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:56.833111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:56.833170 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:56.833244 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:56.835102 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:56.836157 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:56.837418 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:56.838106 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:56.838218 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:56.841117 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:56.841123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:56.841127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:17:56.841160 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:56.844675 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:56.845653 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:56.845658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:56.845661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:56.845832 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:17:56.846371 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:17:56.846375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:17:56.846378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:17:56.846799 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:56.847063 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:56.847438 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 03:17:56.847607 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:17:56.851352 19755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:56.860019 19755 catalog_manager.cc:1347] Generated new cluster ID: 4f7673b3dc564472ad2133fa1c44d71b
I20260810 03:17:56.860143 19755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:56.876962 19755 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:56.878099 19755 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:56.890105 19755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bed21d78645947b29b170507d2f04e82: Generated new TSK 0
I20260810 03:17:56.890779 19755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:56.897070 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19620
I20260810 03:17:56.898415 19711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:17:56.985190 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19620
W20260810 03:17:57.007879 19598 connection.cc:535] client connection to 127.18.112.126:35263 recv error: Network error: failed to read from TLS socket (remote: 127.18.112.126:35263): Connection reset by peer (error 104)
2026-08-10T03:17:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:57 dist-test-slave-jlzn krb5kdc[19772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:57 dist-test-slave-jlzn krb5kdc[19772](info): set up 2 sockets
Aug 10 03:17:57 dist-test-slave-jlzn krb5kdc[19772](info): commencing operation
krb5kdc: starting...
W20260810 03:17:58.186288 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:17:58 dist-test-slave-jlzn krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:17:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:17:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:17:58.438006 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34783
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:34783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:17:58.751516 19798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:17:58.751786 19798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:17:58.751945 19798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:17:58.758780 19798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:17:58.758880 19798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:17:58.758956 19798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:17:58.759033 19798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:17:58.759094 19798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:17:58.768285 19798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:34783
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:17:58.769398 19798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:17:58.770606 19798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:17:58.781518 19805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:58.781476 19806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:17:58.781553 19809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:17:58.782418 19798 server_base.cc:1034] running on GCE node
I20260810 03:17:58.783113 19798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:17:58.784426 19798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:17:58.785633 19798 hybrid_clock.cc:648] HybridClock initialized: now 1786331878785593 us; error 30 us; skew 500 ppm
I20260810 03:17:58.785946 19798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:17:58 dist-test-slave-jlzn krb5kdc[19772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331878, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:17:58.788940 19798 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:17:58.790176 19798 webserver.cc:460] Webserver started at http://127.18.112.126:39519/ using document root <none> and password file <none>
I20260810 03:17:58.790750 19798 fs_manager.cc:359] Metadata directory not provided
I20260810 03:17:58.790855 19798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:17:58.791090 19798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:17:58.793820 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "a3845037fd814387a3ca9cebd8acfc83"
format_stamp: "Formatted at 2026-08-10 03:17:58 on dist-test-slave-jlzn"
server_key: "708a3315b77656420293b720f162922e"
server_key_iv: "7838b6d6c169369c0dd58241a6fc1475"
server_key_version: "encryptionkey@0"
I20260810 03:17:58.794493 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "a3845037fd814387a3ca9cebd8acfc83"
format_stamp: "Formatted at 2026-08-10 03:17:58 on dist-test-slave-jlzn"
server_key: "708a3315b77656420293b720f162922e"
server_key_iv: "7838b6d6c169369c0dd58241a6fc1475"
server_key_version: "encryptionkey@0"
I20260810 03:17:58.799314 19798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:17:58.802690 19819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:17:58.803892 19798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:17:58.804059 19798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "a3845037fd814387a3ca9cebd8acfc83"
format_stamp: "Formatted at 2026-08-10 03:17:58 on dist-test-slave-jlzn"
server_key: "708a3315b77656420293b720f162922e"
server_key_iv: "7838b6d6c169369c0dd58241a6fc1475"
server_key_version: "encryptionkey@0"
I20260810 03:17:58.804245 19798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:17:58.816933 19798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:17:58.820423 19798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:17:58.820647 19798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:17:58.837035 19798 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:34783
I20260810 03:17:58.837064 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:34783 every 8 connection(s)
I20260810 03:17:58.838294 19798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:17:58.839542 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19798
I20260810 03:17:58.839709 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:17:58.840301 18881 external_mini_cluster.cc:1428] Setting key 5aa0193f9d5c7c6828b99d0adb48b804
I20260810 03:17:58.842414 19908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:17:58.855084 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:58.842117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45223 (local address 127.18.112.126:34783)
0810 03:17:58.843045 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:58.843060 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:58.843398 (+ 338us) server_negotiation.cc:407] Connection header received
0810 03:17:58.845500 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:58.845528 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:58.846014 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:58.846445 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:58.846951 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:58.848961 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:58.850211 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:58.851209 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:58.851394 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:58.852477 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:58.852488 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:58.852505 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:58.853215 (+ 710us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:58.853307 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:58.853338 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:58.853520 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:58.853684 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 03:17:58.853856 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":427,"threads_started":1}
I20260810 03:17:58.856483 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83: Bootstrap starting.
I20260810 03:17:58.858542 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:17:58.859611 19908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83: Neither blocks nor log segments found. Creating new log.
I20260810 03:17:58.860797 19908 log.cc:824] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83: Log is configured to *not* fsync() on all Append() calls
I20260810 03:17:58.863571 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83: No bootstrap required, opened a new log
I20260810 03:17:58.871552 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:17:58.863401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54617 (local address 127.18.112.126:34783)
0810 03:17:58.863668 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0810 03:17:58.863699 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0810 03:17:58.864472 (+ 773us) server_negotiation.cc:407] Connection header received
0810 03:17:58.864650 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:17:58.864654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:17:58.864716 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:17:58.864801 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:17:58.865477 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:58.866603 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:58.868411 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:17:58.869160 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:17:58.869303 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:17:58.870568 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:17:58.870579 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:17:58.870585 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:17:58.870605 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:17:58.870647 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:17:58.870668 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:17:58.870784 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:17:58.871164 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 03:17:58.871215 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260810 03:17:58.873824 19908 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } }
I20260810 03:17:58.874152 19908 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:17:58.874244 19908 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3845037fd814387a3ca9cebd8acfc83, State: Initialized, Role: FOLLOWER
I20260810 03:17:58.874733 19908 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } }
I20260810 03:17:58.874948 19908 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:17:58.875078 19908 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:17:58.875238 19908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:17:58.877389 19908 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } }
I20260810 03:17:58.877837 19908 leader_election.cc:302] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3845037fd814387a3ca9cebd8acfc83; no voters:
I20260810 03:17:58.878327 19908 leader_election.cc:288] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:17:58.878436 19924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:17:58.879065 19924 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [term 1 LEADER]: Becoming Leader. State: Replica: a3845037fd814387a3ca9cebd8acfc83, State: Running, Role: LEADER
I20260810 03:17:58.879606 19924 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } }
I20260810 03:17:58.880311 19908 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:17:58.882434 19926 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3845037fd814387a3ca9cebd8acfc83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } } }
I20260810 03:17:58.882488 19927 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3845037fd814387a3ca9cebd8acfc83. Latest consensus state: current_term: 1 leader_uuid: "a3845037fd814387a3ca9cebd8acfc83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3845037fd814387a3ca9cebd8acfc83" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34783 } } }
I20260810 03:17:58.882790 19926 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:58.882818 19927 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83 [sys.catalog]: This master's current role is: LEADER
I20260810 03:17:58.884040 19930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:17:58.890579 19930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:17:58.899453 19930 catalog_manager.cc:1347] Generated new cluster ID: 1cd07f3a23cc48dba45487354c2f1f81
I20260810 03:17:58.899554 19930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:17:58.919699 19930 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:17:58.920845 19930 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:17:58.933112 19930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3845037fd814387a3ca9cebd8acfc83: Generated new TSK 0
I20260810 03:17:58.933773 19930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:17:58.941293 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19798
W20260810 03:17:58.942613 19899 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45223
W20260810 03:17:58.943269 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19798: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:17:58.943416 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19798
W20260810 03:17:58.964926 19769 connection.cc:535] client connection to 127.18.112.126:34783 recv error: Network error: failed to read from TLS socket (remote: 127.18.112.126:34783): Connection reset by peer (error 104)
2026-08-10T03:17:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1957 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:17:59 dist-test-slave-jlzn krb5kdc[19959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:17:59 dist-test-slave-jlzn krb5kdc[19959](info): set up 2 sockets
Aug 10 03:17:59 dist-test-slave-jlzn krb5kdc[19959](info): commencing operation
krb5kdc: starting...
W20260810 03:18:00.141938 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.007s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:00 dist-test-slave-jlzn krb5kdc[19959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:00.398814 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41499
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:34615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:41499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:00.718389 19980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:00.718660 19980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:00.718791 19980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:00.726040 19980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:00.726142 19980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:00.726217 19980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:00.726297 19980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:00.726359 19980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:00.735651 19980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:34615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:41499
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:41499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:00.736797 19980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:00.737988 19980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:00.748966 19986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:00.749001 19985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:00.749138 19992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:00.749662 19980 server_base.cc:1034] running on GCE node
I20260810 03:18:00.750362 19980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:00.751585 19980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:00.752784 19980 hybrid_clock.cc:648] HybridClock initialized: now 1786331880752722 us; error 52 us; skew 500 ppm
I20260810 03:18:00.753098 19980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:00 dist-test-slave-jlzn krb5kdc[19959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331880, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:00.760120 19980 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:00.761467 19980 webserver.cc:460] Webserver started at http://127.18.112.126:39147/ using document root <none> and password file <none>
I20260810 03:18:00.762095 19980 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:00.762215 19980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:00.762499 19980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:00.765364 19980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "1b1107fea2514f4abba724ca7a301f31"
format_stamp: "Formatted at 2026-08-10 03:18:00 on dist-test-slave-jlzn"
server_key: "37e54348545b9a06d254a837894bb2ad"
server_key_iv: "e7a173c24937c6d46398025d29a4e845"
server_key_version: "encryptionkey@0"
I20260810 03:18:00.766104 19980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "1b1107fea2514f4abba724ca7a301f31"
format_stamp: "Formatted at 2026-08-10 03:18:00 on dist-test-slave-jlzn"
server_key: "37e54348545b9a06d254a837894bb2ad"
server_key_iv: "e7a173c24937c6d46398025d29a4e845"
server_key_version: "encryptionkey@0"
I20260810 03:18:00.770864 19980 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 03:18:00.774111 20003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:00.775322 19980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:18:00.775482 19980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "1b1107fea2514f4abba724ca7a301f31"
format_stamp: "Formatted at 2026-08-10 03:18:00 on dist-test-slave-jlzn"
server_key: "37e54348545b9a06d254a837894bb2ad"
server_key_iv: "e7a173c24937c6d46398025d29a4e845"
server_key_version: "encryptionkey@0"
I20260810 03:18:00.775678 19980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:00.781092 19980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:00.785115 19980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:00.785379 19980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:00.802392 19980 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:41499
I20260810 03:18:00.802423 20079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:41499 every 8 connection(s)
I20260810 03:18:00.803655 19980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:00.807325 20080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:00.809762 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 19980
I20260810 03:18:00.809932 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:00.810449 18881 external_mini_cluster.cc:1428] Setting key 1dcf69627e71b02cf87e821da3619887
I20260810 03:18:00.817847 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:00.812221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57367 (local address 127.18.112.126:41499)
0810 03:18:00.813050 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:00.813061 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:00.813102 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:18:00.814692 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:00.814713 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:00.815041 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:00.815340 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:00.816399 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:00.816405 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:00.816417 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:00.816431 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:00.816500 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:00.816520 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:00.816685 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:00.816787 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 03:18:00.816955 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":373,"threads_started":1}
I20260810 03:18:00.819198 20080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31: Bootstrap starting.
I20260810 03:18:00.821405 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:00.822314 20080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:00.823237 20080 log.cc:824] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:00.825819 20080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31: No bootstrap required, opened a new log
I20260810 03:18:00.827828 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:00.825478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40279 (local address 127.18.112.126:41499)
0810 03:18:00.825642 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:00.825648 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:00.826087 (+ 439us) server_negotiation.cc:407] Connection header received
0810 03:18:00.826212 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:00.826217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:00.826280 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:00.826390 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:00.827195 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:00.827200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:00.827204 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:00.827222 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:00.827272 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:00.827291 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:00.827406 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:00.827470 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 03:18:00.827525 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:18:00.833752 20080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } }
I20260810 03:18:00.834048 20080 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:18:00.834118 20080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1107fea2514f4abba724ca7a301f31, State: Initialized, Role: FOLLOWER
I20260810 03:18:00.834604 20080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } }
I20260810 03:18:00.834828 20080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:18:00.834951 20080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:18:00.835090 20080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:00.837301 20080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } }
I20260810 03:18:00.837738 20080 leader_election.cc:302] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b1107fea2514f4abba724ca7a301f31; no voters:
I20260810 03:18:00.838234 20080 leader_election.cc:288] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:18:00.838353 20092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:00.838968 20092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [term 1 LEADER]: Becoming Leader. State: Replica: 1b1107fea2514f4abba724ca7a301f31, State: Running, Role: LEADER
I20260810 03:18:00.839486 20092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } }
I20260810 03:18:00.840039 20080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:00.842270 20095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1107fea2514f4abba724ca7a301f31. Latest consensus state: current_term: 1 leader_uuid: "1b1107fea2514f4abba724ca7a301f31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } } }
I20260810 03:18:00.842665 20095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:00.847946 20094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b1107fea2514f4abba724ca7a301f31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1107fea2514f4abba724ca7a301f31" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 41499 } } }
I20260810 03:18:00.848181 20094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31 [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:00.848706 20102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:00.853477 20102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:18:00.861754 20102 catalog_manager.cc:1347] Generated new cluster ID: 53a141c64c494fcba5cb57c6870f76cf
I20260810 03:18:00.861852 20102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:00.875948 20102 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:00.876297 20102 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:00.885106 20102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b1107fea2514f4abba724ca7a301f31: Generated new TSK 0
I20260810 03:18:00.885715 20102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:00.892208 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19980
W20260810 03:18:00.893102 20075 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57367
W20260810 03:18:00.893754 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 19980: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:18:00.893882 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 19980
2026-08-10T03:18:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1954 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:18:00 dist-test-slave-jlzn krb5kdc[20124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:18:01 dist-test-slave-jlzn krb5kdc[20124](info): set up 2 sockets
Aug 10 03:18:01 dist-test-slave-jlzn krb5kdc[20124](info): commencing operation
krb5kdc: starting...
W20260810 03:18:02.096583 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.002s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:02 dist-test-slave-jlzn krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:02.364655 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35951
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:35405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:35951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:02.685784 20144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:02.686041 20144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:02.686168 20144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:02.693071 20144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:02.693173 20144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:02.693250 20144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:02.693341 20144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:02.693397 20144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:02.702679 20144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:35405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:35951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:35951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:02.703760 20144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:02.704962 20144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:02.715896 20150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:02.715854 20151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:02.715929 20155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:02.716600 20144 server_base.cc:1034] running on GCE node
I20260810 03:18:02.717348 20144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:02.718619 20144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:02.719844 20144 hybrid_clock.cc:648] HybridClock initialized: now 1786331882719775 us; error 39 us; skew 500 ppm
I20260810 03:18:02.720163 20144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:02 dist-test-slave-jlzn krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331882, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:02.723027 20144 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:02.724429 20144 webserver.cc:460] Webserver started at http://127.18.112.126:40213/ using document root <none> and password file <none>
I20260810 03:18:02.725051 20144 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:02.725170 20144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:02.725451 20144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:02.728307 20144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "72706f8f462a41079bb9123caed06eae"
format_stamp: "Formatted at 2026-08-10 03:18:02 on dist-test-slave-jlzn"
server_key: "45a9c295e7b1ee019b71be8338e95340"
server_key_iv: "f869ab3034820a6770384e6ca293ba3f"
server_key_version: "encryptionkey@0"
I20260810 03:18:02.729041 20144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "72706f8f462a41079bb9123caed06eae"
format_stamp: "Formatted at 2026-08-10 03:18:02 on dist-test-slave-jlzn"
server_key: "45a9c295e7b1ee019b71be8338e95340"
server_key_iv: "f869ab3034820a6770384e6ca293ba3f"
server_key_version: "encryptionkey@0"
I20260810 03:18:02.733764 20144 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:18:02.736889 20164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:02.738047 20144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:18:02.738209 20144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "72706f8f462a41079bb9123caed06eae"
format_stamp: "Formatted at 2026-08-10 03:18:02 on dist-test-slave-jlzn"
server_key: "45a9c295e7b1ee019b71be8338e95340"
server_key_iv: "f869ab3034820a6770384e6ca293ba3f"
server_key_version: "encryptionkey@0"
I20260810 03:18:02.738368 20144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:02.753096 20144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:02.756537 20144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:02.756771 20144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:02.773492 20144 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:35951
I20260810 03:18:02.773511 20246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:35951 every 8 connection(s)
I20260810 03:18:02.774688 20144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:02.778162 20247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:02.778971 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20144
I20260810 03:18:02.779171 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:02.779736 18881 external_mini_cluster.cc:1428] Setting key 6f83e8bfcd9bc42bb15b94a912c3796a
I20260810 03:18:02.791415 20247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae: Bootstrap starting.
Aug 10 03:18:02 dist-test-slave-jlzn krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:02.794715 20247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:02.795845 20247 log.cc:824] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:02.798645 20247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae: No bootstrap required, opened a new log
I20260810 03:18:02.801783 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:02.781441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52877 (local address 127.18.112.126:35951)
0810 03:18:02.782186 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:02.782198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:02.782236 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:18:02.784186 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:02.784207 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:02.784556 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:02.784864 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:02.786569 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:02.787844 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:02.789573 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:02.790186 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:02.790303 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:02.794732 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:02.794740 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:02.794752 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:02.794797 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:02.797922 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:02.798677 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:02.798683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:02.798689 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:02.798865 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:02.799302 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:02.799305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:02.799307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:02.799817 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:02.800038 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:02.800507 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 03:18:02.800826 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":337,"threads_started":1}
I20260810 03:18:02.805127 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:02.807158 20247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } }
I20260810 03:18:02.807569 20247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:18:02.807674 20247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72706f8f462a41079bb9123caed06eae, State: Initialized, Role: FOLLOWER
I20260810 03:18:02.808313 20247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } }
I20260810 03:18:02.808624 20247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:18:02.808772 20247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:18:02.808928 20247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:02.811829 20247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } }
I20260810 03:18:02.812381 20247 leader_election.cc:302] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72706f8f462a41079bb9123caed06eae; no voters:
I20260810 03:18:02.813009 20247 leader_election.cc:288] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:18:02.813146 20258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:02.813741 20258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [term 1 LEADER]: Becoming Leader. State: Replica: 72706f8f462a41079bb9123caed06eae, State: Running, Role: LEADER
I20260810 03:18:02.814363 20258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } }
I20260810 03:18:02.816113 20258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72706f8f462a41079bb9123caed06eae. Latest consensus state: current_term: 1 leader_uuid: "72706f8f462a41079bb9123caed06eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } } }
I20260810 03:18:02.816437 20258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:02.818387 20265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72706f8f462a41079bb9123caed06eae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72706f8f462a41079bb9123caed06eae" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 35951 } } }
I20260810 03:18:02.818692 20265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:02.819141 20247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:02.819370 20268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:02.832218 20268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:18:02.833202 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:02.810227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41567 (local address 127.18.112.126:35951)
0810 03:18:02.810372 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:02.810376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:02.810724 (+ 348us) server_negotiation.cc:407] Connection header received
0810 03:18:02.810866 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:02.810870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:02.810922 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:02.810992 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:02.812784 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:02.813905 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:02.815584 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:02.816372 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:02.816512 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:02.819335 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:02.819342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:02.819346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:02.819381 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:02.829349 (+ 9968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:02.830153 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:02.830158 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:02.830161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:02.830310 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:02.830797 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:02.830802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:02.830805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:02.831250 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:02.832469 (+ 1219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:02.832622 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 03:18:02.832850 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 03:18:02.842200 20268 catalog_manager.cc:1347] Generated new cluster ID: faa9c1cdba4d4368b89bd57ac480c3a4
I20260810 03:18:02.842311 20268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:02.855600 20268 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:02.856814 20268 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:02.866568 20268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72706f8f462a41079bb9123caed06eae: Generated new TSK 0
I20260810 03:18:02.867405 20268 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:02.877779 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20144
I20260810 03:18:02.878804 20238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:02.965728 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20144
2026-08-10T03:18:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:18:03 dist-test-slave-jlzn krb5kdc[20299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:18:03 dist-test-slave-jlzn krb5kdc[20299](info): set up 2 sockets
Aug 10 03:18:03 dist-test-slave-jlzn krb5kdc[20299](info): commencing operation
krb5kdc: starting...
W20260810 03:18:04.168341 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:04 dist-test-slave-jlzn krb5kdc[20299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:04.430529 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33965
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:39881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:33965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:04.746503 20315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:04.746794 20315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:04.746933 20315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:04.753845 20315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:04.753958 20315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:04.754034 20315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:04.754119 20315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:04.754179 20315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:04.763867 20315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:39881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:33965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:33965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:04.765002 20315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:04.766185 20315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:04.776962 20322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:04.776901 20323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:04.776928 20326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:04.777938 20315 server_base.cc:1034] running on GCE node
I20260810 03:18:04.778607 20315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:04.779867 20315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:04.781070 20315 hybrid_clock.cc:648] HybridClock initialized: now 1786331884781015 us; error 47 us; skew 500 ppm
I20260810 03:18:04.781368 20315 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:04 dist-test-slave-jlzn krb5kdc[20299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331884, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:04.784296 20315 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:04.785560 20315 webserver.cc:460] Webserver started at http://127.18.112.126:43647/ using document root <none> and password file <none>
I20260810 03:18:04.786162 20315 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:04.786286 20315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:04.786554 20315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:04.789284 20315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "2f2280ec24994d8389df35616b064e7e"
format_stamp: "Formatted at 2026-08-10 03:18:04 on dist-test-slave-jlzn"
server_key: "dab4d824e5aea4fb2da5a3989f0a991b"
server_key_iv: "ae566be4b5735a9ae4b532db4352f04c"
server_key_version: "encryptionkey@0"
I20260810 03:18:04.789994 20315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "2f2280ec24994d8389df35616b064e7e"
format_stamp: "Formatted at 2026-08-10 03:18:04 on dist-test-slave-jlzn"
server_key: "dab4d824e5aea4fb2da5a3989f0a991b"
server_key_iv: "ae566be4b5735a9ae4b532db4352f04c"
server_key_version: "encryptionkey@0"
I20260810 03:18:04.794734 20315 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:18:04.797890 20342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:04.799046 20315 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:18:04.799206 20315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "2f2280ec24994d8389df35616b064e7e"
format_stamp: "Formatted at 2026-08-10 03:18:04 on dist-test-slave-jlzn"
server_key: "dab4d824e5aea4fb2da5a3989f0a991b"
server_key_iv: "ae566be4b5735a9ae4b532db4352f04c"
server_key_version: "encryptionkey@0"
I20260810 03:18:04.799378 20315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:04.818281 20315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:04.822192 20315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:04.822429 20315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:04.838217 20315 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:33965
I20260810 03:18:04.838253 20421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:33965 every 8 connection(s)
I20260810 03:18:04.839422 20315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:04.842157 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20315
I20260810 03:18:04.842329 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:04.842739 18881 external_mini_cluster.cc:1428] Setting key f09ef20ecf848ed1078f89b2b520b331
I20260810 03:18:04.843010 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:04.855265 20422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e: Bootstrap starting.
I20260810 03:18:04.855423 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:04.844341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56453 (local address 127.18.112.126:33965)
0810 03:18:04.845126 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:04.845146 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:04.845185 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:18:04.847377 (+ 2192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:04.847399 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:04.847752 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:04.848151 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:04.848666 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:04.849958 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:04.851230 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:04.851928 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:04.852106 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:04.853275 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:04.853287 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:04.853306 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:04.853959 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:04.854036 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:04.854060 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:04.854155 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:04.854354 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 03:18:04.854532 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":394,"threads_started":1}
I20260810 03:18:04.858624 20422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:04.859056 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:04.859670 20422 log.cc:824] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:04.862064 20422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e: No bootstrap required, opened a new log
I20260810 03:18:04.872121 20422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } }
I20260810 03:18:04.872587 20422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:18:04.872722 20422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f2280ec24994d8389df35616b064e7e, State: Initialized, Role: FOLLOWER
I20260810 03:18:04.873363 20422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } }
I20260810 03:18:04.873629 20422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:18:04.873760 20422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:18:04.873914 20422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:04.876255 20422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } }
I20260810 03:18:04.876725 20422 leader_election.cc:302] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f2280ec24994d8389df35616b064e7e; no voters:
I20260810 03:18:04.878405 20422 leader_election.cc:288] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:18:04.879133 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:04.863127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57453 (local address 127.18.112.126:33965)
0810 03:18:04.864041 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:04.864049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:04.864704 (+ 655us) server_negotiation.cc:407] Connection header received
0810 03:18:04.864899 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:04.864924 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:04.865000 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:04.865094 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:04.865724 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:04.866745 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:04.868487 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:04.869283 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:04.869466 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:04.876872 (+ 7406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:04.876879 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:04.876884 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:04.876904 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:04.876949 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:04.876970 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:04.877066 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:04.878364 (+ 1298us) server_negotiation.cc:299] Negotiation successful
0810 03:18:04.878470 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724}
I20260810 03:18:04.878515 20436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:04.879971 20436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [term 1 LEADER]: Becoming Leader. State: Replica: 2f2280ec24994d8389df35616b064e7e, State: Running, Role: LEADER
I20260810 03:18:04.880506 20436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } }
I20260810 03:18:04.880853 20422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:04.883466 20438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f2280ec24994d8389df35616b064e7e. Latest consensus state: current_term: 1 leader_uuid: "2f2280ec24994d8389df35616b064e7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } } }
I20260810 03:18:04.883826 20438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:04.883554 20437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f2280ec24994d8389df35616b064e7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f2280ec24994d8389df35616b064e7e" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 33965 } } }
I20260810 03:18:04.883957 20437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:04.884620 20443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:04.891520 20443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:18:04.899994 20443 catalog_manager.cc:1347] Generated new cluster ID: 3b79baa1f85f4972884a420626c917b7
I20260810 03:18:04.900095 20443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:04.923954 20443 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:04.925081 20443 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:04.931825 20443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f2280ec24994d8389df35616b064e7e: Generated new TSK 0
I20260810 03:18:04.932471 20443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:04.939234 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20315
W20260810 03:18:04.940201 20417 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56453
W20260810 03:18:04.940819 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20315: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:18:04.940938 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20315
2026-08-10T03:18:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1974 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:18:05 dist-test-slave-jlzn krb5kdc[20464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:18:05 dist-test-slave-jlzn krb5kdc[20464](info): set up 2 sockets
Aug 10 03:18:05 dist-test-slave-jlzn krb5kdc[20464](info): commencing operation
krb5kdc: starting...
W20260810 03:18:06.133841 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:06 dist-test-slave-jlzn krb5kdc[20464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:06.394766 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34795
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:39801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:34795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:06.713030 20481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:06.713299 20481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:06.713395 20481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:06.720347 20481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:06.720441 20481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:06.720492 20481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:06.720551 20481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:06.720595 20481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:06.729821 20481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:39801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:34795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:34795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:06.730878 20481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:06.732142 20481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:06.742906 20488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:06.742944 20489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:06.742864 20492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:06.743872 20481 server_base.cc:1034] running on GCE node
I20260810 03:18:06.744580 20481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:06.745811 20481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:06.747017 20481 hybrid_clock.cc:648] HybridClock initialized: now 1786331886746974 us; error 44 us; skew 500 ppm
I20260810 03:18:06.747336 20481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:06 dist-test-slave-jlzn krb5kdc[20464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331886, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:06.754036 20481 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:06.755373 20481 webserver.cc:460] Webserver started at http://127.18.112.126:37051/ using document root <none> and password file <none>
I20260810 03:18:06.756029 20481 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:06.756155 20481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:06.756449 20481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:06.759193 20481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "48a0096214e14760be84e908329c226d"
format_stamp: "Formatted at 2026-08-10 03:18:06 on dist-test-slave-jlzn"
server_key: "cd78aa3db8d34794ff07d882cba59e87"
server_key_iv: "036121e46e2104787ec13707da5967d9"
server_key_version: "encryptionkey@0"
I20260810 03:18:06.759958 20481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "48a0096214e14760be84e908329c226d"
format_stamp: "Formatted at 2026-08-10 03:18:06 on dist-test-slave-jlzn"
server_key: "cd78aa3db8d34794ff07d882cba59e87"
server_key_iv: "036121e46e2104787ec13707da5967d9"
server_key_version: "encryptionkey@0"
I20260810 03:18:06.764726 20481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:18:06.767881 20502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:06.769009 20481 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:18:06.769178 20481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "48a0096214e14760be84e908329c226d"
format_stamp: "Formatted at 2026-08-10 03:18:06 on dist-test-slave-jlzn"
server_key: "cd78aa3db8d34794ff07d882cba59e87"
server_key_iv: "036121e46e2104787ec13707da5967d9"
server_key_version: "encryptionkey@0"
I20260810 03:18:06.769351 20481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:06.774518 20481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:06.778412 20481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:06.778678 20481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:06.795542 20481 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:34795
I20260810 03:18:06.795575 20575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:34795 every 8 connection(s)
I20260810 03:18:06.796823 20481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:06.800235 20576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:06.806494 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20481
I20260810 03:18:06.806649 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:06.807057 18881 external_mini_cluster.cc:1428] Setting key e752801792f96dbed52df2a8e18fb4ad
I20260810 03:18:06.810710 20576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d: Bootstrap starting.
I20260810 03:18:06.814713 20576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:06.815706 20579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:06.808746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54973 (local address 127.18.112.126:34795)
0810 03:18:06.809600 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:06.809616 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:06.809668 (+ 52us) server_negotiation.cc:407] Connection header received
0810 03:18:06.811975 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:06.812011 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:06.812423 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:06.812884 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:06.813809 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:06.813817 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:06.813834 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:06.813852 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:06.813922 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:06.813950 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:06.814127 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:06.814252 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 03:18:06.814433 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":348,"threads_started":1}
I20260810 03:18:06.816075 20576 log.cc:824] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:06.819164 20576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d: No bootstrap required, opened a new log
I20260810 03:18:06.819500 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:06.825906 20579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:06.823562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53315 (local address 127.18.112.126:34795)
0810 03:18:06.823707 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:06.823713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:06.824131 (+ 418us) server_negotiation.cc:407] Connection header received
0810 03:18:06.824295 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:06.824299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:06.824350 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:06.824428 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:06.825315 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:06.825319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:06.825322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:18:06.825336 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:06.825375 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:18:06.825389 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:06.825501 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:06.825589 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 03:18:06.825643 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:18:06.827134 20576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } }
I20260810 03:18:06.827461 20576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:18:06.827550 20576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a0096214e14760be84e908329c226d, State: Initialized, Role: FOLLOWER
I20260810 03:18:06.828080 20576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } }
I20260810 03:18:06.828303 20576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:18:06.828430 20576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:18:06.828591 20576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:06.830852 20576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } }
I20260810 03:18:06.831322 20576 leader_election.cc:302] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48a0096214e14760be84e908329c226d; no voters:
I20260810 03:18:06.831897 20576 leader_election.cc:288] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:18:06.831990 20587 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:06.832600 20587 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [term 1 LEADER]: Becoming Leader. State: Replica: 48a0096214e14760be84e908329c226d, State: Running, Role: LEADER
I20260810 03:18:06.833135 20587 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } }
I20260810 03:18:06.833825 20576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:06.835932 20589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48a0096214e14760be84e908329c226d. Latest consensus state: current_term: 1 leader_uuid: "48a0096214e14760be84e908329c226d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } } }
I20260810 03:18:06.835906 20588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48a0096214e14760be84e908329c226d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48a0096214e14760be84e908329c226d" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 34795 } } }
I20260810 03:18:06.836378 20588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:06.836375 20589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:06.841544 20594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:06.846786 20594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:18:06.854920 20594 catalog_manager.cc:1347] Generated new cluster ID: cbac838420b343f789a29c215db68a83
I20260810 03:18:06.855026 20594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:06.863003 20594 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:06.863447 20594 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:06.871172 20594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48a0096214e14760be84e908329c226d: Generated new TSK 0
I20260810 03:18:06.872162 20594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:06.880956 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20481
W20260810 03:18:06.882100 20570 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54973
W20260810 03:18:06.882706 18881 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20481: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 03:18:06.882825 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20481
2026-08-10T03:18:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1946 ms)
[----------] 18 tests from AuthTokenIssuingTest (35724 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:18:06 dist-test-slave-jlzn krb5kdc[20618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:18:06 dist-test-slave-jlzn krb5kdc[20618](info): set up 2 sockets
Aug 10 03:18:06 dist-test-slave-jlzn krb5kdc[20618](info): commencing operation
krb5kdc: starting...
W20260810 03:18:08.079373 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:08 dist-test-slave-jlzn krb5kdc[20618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:08.348297 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:32991
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:08.661761 20637 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:08.662077 20637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:08.662181 20637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:08.662293 20637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:08.669186 20637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:08.669269 20637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:08.669355 20637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:08.669418 20637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:08.669500 20637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:08.678610 20637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:32991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:08.679713 20637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:08.680892 20637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:08.691563 20645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:08.691592 20650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:08.691649 20647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:08.692549 20637 server_base.cc:1034] running on GCE node
I20260810 03:18:08.693262 20637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:08.694480 20637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:08.695701 20637 hybrid_clock.cc:648] HybridClock initialized: now 1786331888695636 us; error 32 us; skew 500 ppm
I20260810 03:18:08.696034 20637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:08 dist-test-slave-jlzn krb5kdc[20618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:08.698958 20637 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:08.700270 20637 webserver.cc:460] Webserver started at http://127.18.112.126:43261/ using document root <none> and password file <none>
I20260810 03:18:08.700901 20637 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:08.700999 20637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:08.701288 20637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:08.704059 20637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "90191eab8c094c98a7f1f3f4210d4f3c"
format_stamp: "Formatted at 2026-08-10 03:18:08 on dist-test-slave-jlzn"
server_key: "34977ce3681ff73bbb3fcd0299c5a6a9"
server_key_iv: "86c87fb647d9fbdb30181221fd739768"
server_key_version: "encryptionkey@0"
I20260810 03:18:08.704815 20637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "90191eab8c094c98a7f1f3f4210d4f3c"
format_stamp: "Formatted at 2026-08-10 03:18:08 on dist-test-slave-jlzn"
server_key: "34977ce3681ff73bbb3fcd0299c5a6a9"
server_key_iv: "86c87fb647d9fbdb30181221fd739768"
server_key_version: "encryptionkey@0"
I20260810 03:18:08.709442 20637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:18:08.712563 20664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:08.713743 20637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:18:08.713907 20637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "90191eab8c094c98a7f1f3f4210d4f3c"
format_stamp: "Formatted at 2026-08-10 03:18:08 on dist-test-slave-jlzn"
server_key: "34977ce3681ff73bbb3fcd0299c5a6a9"
server_key_iv: "86c87fb647d9fbdb30181221fd739768"
server_key_version: "encryptionkey@0"
I20260810 03:18:08.714093 20637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:08.733469 20637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:08.737429 20637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:08.737668 20637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:08.754669 20637 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:32991
I20260810 03:18:08.754705 20751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:32991 every 8 connection(s)
I20260810 03:18:08.755887 20637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:08.759181 20752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:08.759220 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20637
I20260810 03:18:08.759408 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:08.760078 18881 external_mini_cluster.cc:1428] Setting key 1ebd56c94235dd119115e728b3ef8c83
I20260810 03:18:08.765262 20752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:08 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:08.786204 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.768086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.18.112.126:32991)
0810 03:18:08.769586 (+ 1500us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:08.769597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:08.769649 (+ 52us) server_negotiation.cc:407] Connection header received
0810 03:18:08.771082 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:08.771090 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:08.771346 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:08.771599 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:08.772668 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:08.774113 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:08.775619 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:08.776192 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:08.776371 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:08.779690 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:08.779698 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:08.779709 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:08.779742 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:08.782282 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:08.782940 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:08.782945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:08.782948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:08.783100 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:08.783460 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:08.783464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:08.783466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:08.783944 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:08.784133 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:08.784626 (+ 493us) server_negotiation.cc:299] Negotiation successful
0810 03:18:08.784880 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":1291,"spinlock_wait_cycles":34176,"thread_start_us":1118,"threads_started":1}
I20260810 03:18:08.786224 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.768087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:32991 (local address 127.0.0.1:60478)
0810 03:18:08.768909 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.768967 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:08.770716 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:08.771567 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:08.771572 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:08.772132 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:08.772464 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:08.772482 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:08.774267 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:08.774272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:08.775499 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:08.775512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:08.776419 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:08.776426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:08.776705 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:08.777265 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:08.777293 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:08.779457 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:08.782404 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:08.782416 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:08.782426 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:08.782822 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:08.783205 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:08.783210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:08.783214 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:08.783359 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:08.784073 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:08.784080 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:08.784275 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 03:18:08.784478 (+ 203us) client_negotiation.cc:240] Negotiation successful
0810 03:18:08.785010 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":180,"thread_start_us":333,"threads_started":1}
I20260810 03:18:08.789093 20752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.112.125@KRBTEST.COM; defaulting to no policy
I20260810 03:18:08.790169 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.789789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:58980)
0810 03:18:08.789944 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.790050 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 03:18:08.790452 20666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
I20260810 03:18:08.791972 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.791473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:58992)
0810 03:18:08.791692 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.791771 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260810 03:18:08.792193 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36085: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
I20260810 03:18:08.822755 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:36085
--webserver_interface=127.18.112.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:18:08.841512 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } attempt: 1
I20260810 03:18:08.842617 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.842187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:58994)
0810 03:18:08.842374 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.842493 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 03:18:08.843523 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.843189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59006)
0810 03:18:08.843331 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.843399 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 03:18:08.843701 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36085: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
I20260810 03:18:08.911908 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } attempt: 2
I20260810 03:18:08.912973 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.912518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59022)
0810 03:18:08.912755 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.912838 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 03:18:08.913897 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:08.913553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59034)
0810 03:18:08.913705 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:08.913771 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:18:08.914074 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36085: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
I20260810 03:18:09.005316 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } attempt: 3
I20260810 03:18:09.006467 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.006050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59036)
0810 03:18:09.006244 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.006334 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 03:18:09.007422 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.007069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59052)
0810 03:18:09.007222 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.007291 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:18:09.007609 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36085: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
W20260810 03:18:09.139683 20765 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:09.140002 20765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:09.140098 20765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:09.140214 20765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:09.147135 20765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:09.147220 20765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:09.147307 20765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:09.147374 20765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:09.147459 20765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:09.150816 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } attempt: 4
I20260810 03:18:09.151914 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.151355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59066)
0810 03:18:09.151657 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.151744 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
I20260810 03:18:09.152839 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.152488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59082)
0810 03:18:09.152630 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.152714 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:18:09.153007 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36085: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36085: connect: Connection refused (error 111)
I20260810 03:18:09.157035 20765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:36085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.112.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:09.158145 20765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:09.159351 20765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:09.169986 20771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:09.170118 20776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:09.170163 20773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:09.170941 20765 server_base.cc:1034] running on GCE node
I20260810 03:18:09.171662 20765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:09.172883 20765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:09.174086 20765 hybrid_clock.cc:648] HybridClock initialized: now 1786331889174029 us; error 31 us; skew 500 ppm
I20260810 03:18:09.174377 20765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:09.177309 20765 init.cc:377] Logged in from keytab as kudu/127.18.112.125@KRBTEST.COM (short username kudu)
I20260810 03:18:09.178613 20765 webserver.cc:460] Webserver started at http://127.18.112.125:44967/ using document root <none> and password file <none>
I20260810 03:18:09.179230 20765 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:09.179322 20765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:09.179610 20765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:09.182363 20765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data/instance:
uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7afa596da5f1e2af0c0a6ced427d3531"
server_key_iv: "c6413d9b5decb1736ab1b793f7422333"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.183100 20765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal/instance:
uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7afa596da5f1e2af0c0a6ced427d3531"
server_key_iv: "c6413d9b5decb1736ab1b793f7422333"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.188791 20765 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260810 03:18:09.192022 20786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:09.193215 20765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:18:09.193372 20765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7afa596da5f1e2af0c0a6ced427d3531"
server_key_iv: "c6413d9b5decb1736ab1b793f7422333"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.193562 20765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:09.214095 20765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:09.217618 20765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:09.217847 20765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:09.234422 20765 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.125:36085
I20260810 03:18:09.234452 20864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.125:36085 every 8 connection(s)
I20260810 03:18:09.235576 20765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
I20260810 03:18:09.237674 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20765
I20260810 03:18:09.237843 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-1/wal/instance
I20260810 03:18:09.238247 18881 external_mini_cluster.cc:1428] Setting key 50d073478fdbc885262046c768571f1b
I20260810 03:18:09.239061 20865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:09.245390 20865 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:09.264943 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.247682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60492 (local address 127.18.112.126:32991)
0810 03:18:09.247907 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.247914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.249005 (+ 1091us) server_negotiation.cc:407] Connection header received
0810 03:18:09.250768 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.250774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.250850 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.250955 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.252586 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.253257 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.255024 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.255600 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.255722 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.259376 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.259381 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.259385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.259417 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.261979 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.262823 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.262827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.262829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.262940 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.263351 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.263354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.263356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.263604 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.263718 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.264549 (+ 831us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.264722 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:18:09.266209 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.248119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:32991 (local address 127.0.0.1:60492)
0810 03:18:09.248829 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.248879 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.250512 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.251128 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.251135 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.251648 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.252412 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.252432 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.253411 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.253415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.254859 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.254873 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.255854 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.255861 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.256078 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.256661 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.256682 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.259130 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.262123 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.262131 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.262143 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.262721 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.263035 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.263040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.263044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.263258 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.263733 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.263740 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.264167 (+ 427us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.264460 (+ 293us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.264931 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":284,"threads_started":1}
I20260810 03:18:09.267765 20865 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.112.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.124@KRBTEST.COM" created.
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:09.281709 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.268600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59092)
0810 03:18:09.268772 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.268790 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.268895 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.269749 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.269753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.270093 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.270248 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.270257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.271833 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.271838 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.273061 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.273077 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.273831 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.273837 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.273996 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.274471 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.274489 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.276598 (+ 2109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.279425 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.279430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.279434 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.279765 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.280127 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.280132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.280135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.280265 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.280858 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.280863 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.281000 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.281109 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.281356 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 03:18:09.281965 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.268767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.18.112.125:36085)
0810 03:18:09.269379 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.269384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.269409 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:18:09.269449 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.269454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.269616 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.269721 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.270405 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.271670 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.273189 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.273688 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.273780 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.276779 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.276790 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.276801 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.276833 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.279301 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.279902 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.279910 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.279912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.280024 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.280373 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.280376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.280378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.280732 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.280924 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.281279 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.281477 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":354,"threads_started":1}
I20260810 03:18:09.283952 20865 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:09.284932 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.284538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56118)
0810 03:18:09.284685 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.284791 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 03:18:09.285203 20788 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.286644 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.286334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56124)
0810 03:18:09.286469 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.286544 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:18:09.287205 20865 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
I20260810 03:18:09.302752 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:36307
--webserver_interface=127.18.112.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:18:09.336475 20865 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 1
I20260810 03:18:09.337548 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.337117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56126)
0810 03:18:09.337305 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.337403 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 03:18:09.338452 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.338117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56128)
0810 03:18:09.338270 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.338344 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:18:09.338644 20865 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.406834 20865 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 2
I20260810 03:18:09.407752 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.407348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56132)
0810 03:18:09.407523 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.407607 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 03:18:09.408787 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.408468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56136)
0810 03:18:09.408609 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.408677 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:18:09.408981 20865 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.452263 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } attempt: 5
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:09.466455 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.453105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.18.112.125:36085)
0810 03:18:09.453265 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.453269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.453342 (+ 73us) server_negotiation.cc:407] Connection header received
0810 03:18:09.453542 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.453546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.453623 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.453705 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.454757 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.455433 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.457111 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.457555 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.457655 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.461505 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.461510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.461513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.461545 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.464040 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.464816 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.464820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.464822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.464937 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.465324 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.465327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.465329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.465579 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.465691 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.466088 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.466240 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:18:09.466650 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.453028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59102)
0810 03:18:09.453249 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.453269 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.453416 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.453772 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.453777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.454300 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.454616 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.454631 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.455568 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.455574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.456969 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.456985 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.457701 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.457707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.457951 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.458552 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.458579 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.461314 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.464172 (+ 2858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.464177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.464182 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.464701 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.465041 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.465046 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.465050 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.465231 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.465688 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.465693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.465866 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.466029 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.466301 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 03:18:09.467687 20752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:09.468725 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.468302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56138)
0810 03:18:09.468468 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.468570 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 03:18:09.469707 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.469334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56144)
0810 03:18:09.469469 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.469578 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:18:09.469901 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.500166 20865 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 3
I20260810 03:18:09.501063 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.500698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56146)
0810 03:18:09.500850 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.500926 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 03:18:09.502023 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.501648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56162)
0810 03:18:09.501856 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.501926 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260810 03:18:09.502225 20865 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.521123 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 1
I20260810 03:18:09.522149 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.521676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56178)
0810 03:18:09.521865 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.521963 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 03:18:09.523106 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.522732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56180)
0810 03:18:09.522881 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.522970 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:18:09.523309 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.591548 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 2
I20260810 03:18:09.592783 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.592221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56182)
0810 03:18:09.592459 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.592571 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 03:18:09.593813 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.593437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56186)
0810 03:18:09.593582 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.593669 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:18:09.594027 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
W20260810 03:18:09.626860 20876 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:09.627127 20876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:09.627195 20876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:09.627271 20876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:09.634343 20876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:09.634424 20876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:09.634485 20876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:09.634541 20876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:09.634599 20876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:09.643836 20876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:32991,127.18.112.125:36085,127.18.112.124:36307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:36307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.112.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:09.644876 20876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:09.645411 20865 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 4
I20260810 03:18:09.646226 20876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:18:09.646462 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.646024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56200)
0810 03:18:09.646220 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.646305 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 03:18:09.647352 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.647080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56208)
0810 03:18:09.647198 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.647262 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 03:18:09.647534 20865 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
W20260810 03:18:09.657289 20882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:09.657332 20883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:09.657567 20885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:09.658254 20876 server_base.cc:1034] running on GCE node
I20260810 03:18:09.658978 20876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:09.660255 20876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:09.661470 20876 hybrid_clock.cc:648] HybridClock initialized: now 1786331889661407 us; error 37 us; skew 500 ppm
I20260810 03:18:09.661763 20876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:09.664633 20876 init.cc:377] Logged in from keytab as kudu/127.18.112.124@KRBTEST.COM (short username kudu)
I20260810 03:18:09.665956 20876 webserver.cc:460] Webserver started at http://127.18.112.124:40825/ using document root <none> and password file <none>
I20260810 03:18:09.666570 20876 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:09.666672 20876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:09.666994 20876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:09.669767 20876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data/instance:
uuid: "d110ea04198b4cb49e7b8a4835dc733a"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7c91de7c1ac8e18ed699f2c2c4619f42"
server_key_iv: "2d5b5bd41b7109f15f359020d9d6e53a"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.670527 20876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal/instance:
uuid: "d110ea04198b4cb49e7b8a4835dc733a"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7c91de7c1ac8e18ed699f2c2c4619f42"
server_key_iv: "2d5b5bd41b7109f15f359020d9d6e53a"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.675168 20876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 03:18:09.678378 20897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:09.679543 20876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:18:09.679698 20876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "d110ea04198b4cb49e7b8a4835dc733a"
format_stamp: "Formatted at 2026-08-10 03:18:09 on dist-test-slave-jlzn"
server_key: "7c91de7c1ac8e18ed699f2c2c4619f42"
server_key_iv: "2d5b5bd41b7109f15f359020d9d6e53a"
server_key_version: "encryptionkey@0"
I20260810 03:18:09.679932 20876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:09.700271 20876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:09.700250 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 3
I20260810 03:18:09.701270 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.700766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56224)
0810 03:18:09.700981 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.701088 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 03:18:09.702284 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.701879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56230)
0810 03:18:09.702066 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.702161 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260810 03:18:09.702517 20752 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:36307: Network error: Client connection negotiation failed: client connection to 127.18.112.124:36307: connect: Connection refused (error 111)
I20260810 03:18:09.704391 20876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:09.704607 20876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:09.721164 20876 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.124:36307
I20260810 03:18:09.721185 20972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.124:36307 every 8 connection(s)
I20260810 03:18:09.722381 20876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
I20260810 03:18:09.725764 20973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:09.727990 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 20876
I20260810 03:18:09.728156 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786331536832683-18881-0/minicluster-data/master-2/wal/instance
I20260810 03:18:09.728576 18881 external_mini_cluster.cc:1428] Setting key 56bbf45630e2cba4fcb3d8e8ee4bb568
I20260810 03:18:09.732798 20973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:09.748689 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.735294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60498 (local address 127.18.112.126:32991)
0810 03:18:09.735449 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.735453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.736121 (+ 668us) server_negotiation.cc:407] Connection header received
0810 03:18:09.736297 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.736303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.736363 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.736445 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.737516 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.738212 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.739602 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.740242 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.740372 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.743613 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.743618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.743621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.743654 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.745916 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.746553 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.746559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.746562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.746690 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.747054 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.747059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.747062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.747325 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.747443 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.748110 (+ 667us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.748330 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:18:09.749637 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.735313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:32991 (local address 127.0.0.1:60498)
0810 03:18:09.735994 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.736027 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.736181 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.736531 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.736538 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.737135 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.737374 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.737383 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.738363 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.738367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.739468 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.739480 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.740449 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.740454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.740584 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.741098 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.741125 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.743436 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.746042 (+ 2606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.746052 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.746063 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.746439 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.746793 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.746798 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.746801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.746949 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.747455 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.747462 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.747678 (+ 216us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.748012 (+ 334us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.748490 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":116,"thread_start_us":340,"threads_started":1}
I20260810 03:18:09.749656 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.730343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.18.112.124:36307)
0810 03:18:09.731095 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.731105 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.731146 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:18:09.732789 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.732811 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.733169 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.733468 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.735225 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.736937 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.738252 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.738973 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.739149 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.743188 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.743198 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.743212 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.743258 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.745972 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.746572 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.746578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.746580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.746716 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.747074 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.747077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.747079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.747580 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.747901 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.748113 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.748365 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":552,"thread_start_us":322,"threads_started":1}
I20260810 03:18:09.751046 20973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:09.764845 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.751954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36085 (local address 127.0.0.1:59104)
0810 03:18:09.752096 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.752114 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.752205 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.752516 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.752522 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.752954 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.753126 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.753137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.754102 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.754108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.755519 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.755533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.756374 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.756380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.756600 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.757066 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.757087 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.759224 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.762523 (+ 3299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.762527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.762531 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.762984 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.763422 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.763425 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.763428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.763565 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.764184 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.764189 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.764324 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.764436 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.764620 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 03:18:09.765139 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.751798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.18.112.125:36085)
0810 03:18:09.752018 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.752023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.752202 (+ 179us) server_negotiation.cc:407] Connection header received
0810 03:18:09.752292 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.752298 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.752367 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.752459 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.753281 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.753957 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.755746 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.756236 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.756350 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.759399 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.759404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.759407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.759437 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.762375 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.763130 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.763136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.763140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.763304 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.763671 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.763676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.763680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.764031 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.764192 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.764553 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.764770 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:18:09.765976 20973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:09.768175 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.752584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60504 (local address 127.18.112.126:32991)
0810 03:18:09.752726 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.752731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.752793 (+ 62us) server_negotiation.cc:407] Connection header received
0810 03:18:09.752925 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.752928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.752974 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.753056 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.754184 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.755383 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.757088 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.757711 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.757850 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.762405 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.762411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.762415 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.762451 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.765699 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.766342 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.766347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.766350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.766503 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.766874 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.766879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.766883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.767141 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.767403 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.767663 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.767901 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:09.778710 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.766488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56252)
0810 03:18:09.766719 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.766734 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.766825 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.767069 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.767074 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.767419 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.767534 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.767542 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.768683 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.768688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.769614 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.769628 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.770383 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.770388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.770587 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.771120 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.771144 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.773236 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.776484 (+ 3248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.776487 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.776490 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.776836 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.777190 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.777195 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.777199 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.777357 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.777871 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.777876 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.778042 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.778191 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.778450 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":1}
I20260810 03:18:09.778997 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.766574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56252 (local address 127.18.112.124:36307)
0810 03:18:09.766715 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.766720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.766788 (+ 68us) server_negotiation.cc:407] Connection header received
0810 03:18:09.766912 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.766917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.766972 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.767042 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.767663 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.768568 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.769760 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.770252 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.770359 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.773416 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.773421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.773424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.773452 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.776357 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.776951 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.776955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.776957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.777076 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.777473 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.777478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.777481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.777746 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.777851 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.778278 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.778648 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":116,"server-negotiator.queue_time_us":38}
I20260810 03:18:09.783430 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.769568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.18.112.125:36085)
0810 03:18:09.769721 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.769726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.769742 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:18:09.769831 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.769836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.769897 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.769978 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.771009 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.772136 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.773341 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.773744 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.773830 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.778403 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.778407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.778410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.778439 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.781019 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.781711 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.781715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.781717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.781837 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.782210 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.782213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.782215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.782434 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.782617 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.782891 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.783120 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:18:09.784056 20973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: Bootstrap starting.
I20260810 03:18:09.787688 20973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:09.787745 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:09.788944 20973 log.cc:824] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:09.791551 20973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: No bootstrap required, opened a new log
I20260810 03:18:09.790882 20705 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "90191eab8c094c98a7f1f3f4210d4f3c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60504
I20260810 03:18:09.798377 20973 raft_consensus.cc:348] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.798673 20973 raft_consensus.cc:729] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d110ea04198b4cb49e7b8a4835dc733a, State: Initialized, Role: FOLLOWER
I20260810 03:18:09.799082 20973 consensus_queue.cc:260] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.799957 20980 sys_catalog.cc:455] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:09.800348 20980 sys_catalog.cc:458] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:09.800832 20973 sys_catalog.cc:564] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:18:09.809615 20995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:18:09.809741 20995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:18:09.807488 20876 master_runner.cc:186] Error getting master registration for 127.18.112.126:32991: OK, instance_id { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" instance_seqno: 1786331888749838 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:18:09.818286 20876 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:18:09.879748 20752 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 4
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331888, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:18:09.898028 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.880507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56266)
0810 03:18:09.880712 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.880729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.880840 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.881307 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.881313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.881722 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.881894 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.881903 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.883218 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.883224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.884738 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.884754 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.885775 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.885783 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.885998 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.886664 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.886700 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.889487 (+ 2787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.895065 (+ 5578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.895071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.895075 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.895584 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.895967 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.895973 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.895977 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.896139 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.896906 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.896912 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.897109 (+ 197us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.897296 (+ 187us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.897596 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 03:18:09.899011 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.880811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.18.112.124:36307)
0810 03:18:09.881014 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.881019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.881033 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:18:09.881095 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.881099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.881159 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.881243 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.882041 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.883081 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.884916 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.885611 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.885739 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.889709 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.889715 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.889719 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.889764 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.894908 (+ 5144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.895690 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.895694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.895696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.895863 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.896244 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.896249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.896252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.896719 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.896872 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.898404 (+ 1532us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.898623 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:18:09.903873 20752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: Bootstrap starting.
I20260810 03:18:09.907677 20752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:09.908890 20752 log.cc:824] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:09.912037 20752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: No bootstrap required, opened a new log
I20260810 03:18:09.919174 20752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.919540 20752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90191eab8c094c98a7f1f3f4210d4f3c, State: Initialized, Role: FOLLOWER
I20260810 03:18:09.920018 20752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.920961 20998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:09.921334 20998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:09.922163 20752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:09.922281 20705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 03:18:09.922444 20705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:09.925781 20705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.928465 20705 leader_election.cc:288] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [CANDIDATE]: Term 1 election: Requested vote from peers ab1c90e1f1c64ed492cdbdf5bc6ca275 (127.18.112.125:36085), d110ea04198b4cb49e7b8a4835dc733a (127.18.112.124:36307)
I20260810 03:18:09.930825 20933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d110ea04198b4cb49e7b8a4835dc733a"
I20260810 03:18:09.931336 20933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:09.934727 20933 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90191eab8c094c98a7f1f3f4210d4f3c in term 1.
I20260810 03:18:09.935319 20665 leader_election.cc:302] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90191eab8c094c98a7f1f3f4210d4f3c, d110ea04198b4cb49e7b8a4835dc733a; no voters:
I20260810 03:18:09.935729 20998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:09.932103 20637 master_runner.cc:186] Error getting master registration for 127.18.112.125:36085: OK, instance_id { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" instance_seqno: 1786331889229749 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:18:09.943924 20637 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:18:09.944304 20998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [term 1 LEADER]: Becoming Leader. State: Replica: 90191eab8c094c98a7f1f3f4210d4f3c, State: Running, Role: LEADER
I20260810 03:18:09.944816 20998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:09.946719 20865 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } attempt: 5
W20260810 03:18:09.956331 20904 tablet.cc:2369] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:18:09 dist-test-slave-jlzn krb5kdc[20618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331889, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:18:09.969951 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.947228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:36307 (local address 127.0.0.1:56276)
0810 03:18:09.947445 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:09.947469 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:09.947599 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:09.948244 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:09.948249 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:09.948784 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:09.948991 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.949003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.950481 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.950487 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.951907 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:09.951922 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.953170 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.953176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:09.953394 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.954146 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:09.954192 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:09.957902 (+ 3710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:09.964388 (+ 6486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.964394 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.964399 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.965258 (+ 859us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.965952 (+ 694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:09.965957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:09.965961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:09.966204 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:09.967213 (+ 1009us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:09.967219 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:09.967454 (+ 235us) client_negotiation.cc:769] Sending connection context
0810 03:18:09.967655 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 03:18:09.968443 (+ 788us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:18:09.970649 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:09.947537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56276 (local address 127.18.112.124:36307)
0810 03:18:09.947710 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:09.947716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:09.947735 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:18:09.947798 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:09.947827 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:09.947933 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:09.948029 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:09.949201 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.950283 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.952104 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:09.952813 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:09.952937 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:09.958179 (+ 5242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:09.958185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:09.958191 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:09.958227 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:09.964186 (+ 5959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.965421 (+ 1235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.965427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.965431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.965757 (+ 326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:09.966404 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:09.966410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:09.966413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:09.967040 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:09.967991 (+ 951us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:09.968476 (+ 485us) server_negotiation.cc:299] Negotiation successful
0810 03:18:09.969331 (+ 855us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260810 03:18:09.971901 21016 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:18:09.972071 21016 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:18:09.976176 20865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: Bootstrap starting.
I20260810 03:18:09.980069 20865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:09.982252 20865 log.cc:824] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:09.985437 21020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90191eab8c094c98a7f1f3f4210d4f3c. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:09.986174 21020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: This master's current role is: LEADER
W20260810 03:18:09.990123 20671 tablet.cc:2369] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:18:09.994194 21028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:10.004607 20865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: No bootstrap required, opened a new log
I20260810 03:18:10.018450 20865 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:10.018862 20865 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1c90e1f1c64ed492cdbdf5bc6ca275, State: Initialized, Role: FOLLOWER
I20260810 03:18:10.019371 20865 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } }
I20260810 03:18:10.022509 21028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:18:10.026516 21038 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.026947 21038 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:10.027346 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.008440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.18.112.125:36085)
0810 03:18:10.008594 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.008598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.009942 (+ 1344us) server_negotiation.cc:407] Connection header received
0810 03:18:10.010169 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.010175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.010247 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.010318 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.012416 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.013476 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.015321 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.016032 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.016139 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.019590 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:10.019597 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:10.019602 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:10.019639 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:10.023484 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.024520 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.024526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.024530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.024716 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.025236 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.025241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.025244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.025637 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:10.025971 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.026601 (+ 630us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.026865 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 03:18:10.030203 20865 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:10.030364 20830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275"
I20260810 03:18:10.030794 20830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:10.034263 20830 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90191eab8c094c98a7f1f3f4210d4f3c in term 1.
I20260810 03:18:10.044450 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.010005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56284 (local address 127.18.112.124:36307)
0810 03:18:10.010185 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.010194 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.028469 (+ 18275us) server_negotiation.cc:407] Connection header received
0810 03:18:10.028717 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.028723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.028799 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.028867 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.030624 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.031918 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.033550 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.034201 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.034289 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.037327 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:10.037334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:10.037339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:10.037374 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:10.040751 (+ 3377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.041537 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.041543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.041547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.041709 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.042141 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.042146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.042150 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.042512 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:10.042784 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.043798 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.044072 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:18:10.054929 20933 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [term 1 FOLLOWER]: Refusing update from remote peer 90191eab8c094c98a7f1f3f4210d4f3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:18:10.056011 21020 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:18:10.065313 20830 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [term 1 FOLLOWER]: Refusing update from remote peer 90191eab8c094c98a7f1f3f4210d4f3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:18:10.066125 21020 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:18:10.073257 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.009045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60514 (local address 127.18.112.126:32991)
0810 03:18:10.012651 (+ 3606us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.012657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.012679 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:18:10.012735 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.012740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.012811 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.012905 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.029142 (+ 16237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.030139 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.045575 (+ 15436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.046328 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.046429 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.052719 (+ 6290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:10.052726 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:10.052730 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:10.052771 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:10.064273 (+ 11502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.069708 (+ 5435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.069715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.069718 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.069914 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:10.070794 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:10.070800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:10.070803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:10.071214 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:10.071519 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.072577 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.072852 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:18:10.083550 20980 sys_catalog.cc:455] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90191eab8c094c98a7f1f3f4210d4f3c. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.083897 20980 sys_catalog.cc:458] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:10.088528 21041 mvcc.cc:205] Tried to move back new op lower bound from 7316815421633871872 to 7316815421218394112. Current Snapshot: MvccSnapshot[applied={T|T < 7316815421633871872}]
I20260810 03:18:10.093555 21038 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90191eab8c094c98a7f1f3f4210d4f3c. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.093873 21038 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:10.094465 21047 mvcc.cc:205] Tried to move back new op lower bound from 7316815421633871872 to 7316815421218394112. Current Snapshot: MvccSnapshot[applied={T|T < 7316815421633871872}]
I20260810 03:18:10.108157 20980 sys_catalog.cc:455] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.108414 20980 sys_catalog.cc:458] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:10.116710 21038 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.116993 21038 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:10.119040 21020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.119328 21020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:10.119544 21020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90191eab8c094c98a7f1f3f4210d4f3c" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 32991 } } peers { permanent_uuid: "ab1c90e1f1c64ed492cdbdf5bc6ca275" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36085 } } peers { permanent_uuid: "d110ea04198b4cb49e7b8a4835dc733a" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 36307 } } }
I20260810 03:18:10.119719 21020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:10.120460 21028 catalog_manager.cc:1347] Generated new cluster ID: 911c3d3bd2ea48ca935ce848793fc645
I20260810 03:18:10.120572 21028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:10.155417 21028 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:10.157325 21028 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:10.187495 21028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90191eab8c094c98a7f1f3f4210d4f3c: Generated new TSK 0
I20260810 03:18:10.188971 21028 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:10.246836 21066 catalog_manager.cc:1259] Loaded cluster ID: 911c3d3bd2ea48ca935ce848793fc645
I20260810 03:18:10.246966 21066 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: loading cluster ID for follower catalog manager: success
I20260810 03:18:10.250674 21066 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: acquiring CA information for follower catalog manager: success
I20260810 03:18:10.255865 21066 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ab1c90e1f1c64ed492cdbdf5bc6ca275: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 03:18:10.308713 18881 mini_kdc.cc:348] Time spent kdestroy: real 0.106s user 0.004s sys 0.025s
W20260810 03:18:10.322551 20872 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.314118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59134 (local address 127.18.112.125:36085)
0810 03:18:10.314520 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.314525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.320637 (+ 6112us) server_negotiation.cc:407] Connection header received
0810 03:18:10.320943 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.320949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.321056 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.321133 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.322283 (+ 1150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59134: BlockingRecv error: recv got EOF from 127.0.0.1:59134 (error 108)
Metrics: {"server-negotiator.queue_time_us":271}
W20260810 03:18:10.324958 20756 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.313926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60516 (local address 127.18.112.126:32991)
0810 03:18:10.314359 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.314366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.320377 (+ 6011us) server_negotiation.cc:407] Connection header received
0810 03:18:10.323280 (+ 2903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.323287 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.323373 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.323445 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.324711 (+ 1266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60516: BlockingRecv error: recv got EOF from 127.0.0.1:60516 (error 108)
Metrics: {"server-negotiator.queue_time_us":262}
W20260810 03:18:10.325022 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.320795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56292 (local address 127.18.112.124:36307)
0810 03:18:10.320965 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.320971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.323247 (+ 2276us) server_negotiation.cc:407] Connection header received
0810 03:18:10.323521 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.323527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.323605 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.323682 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.324795 (+ 1113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56292: BlockingRecv error: recv got EOF from 127.0.0.1:56292 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:18:10.337987 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.330516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59144 (local address 127.18.112.125:36085)
0810 03:18:10.330671 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.330676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.331096 (+ 420us) server_negotiation.cc:407] Connection header received
0810 03:18:10.331293 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.331299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.331513 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.331669 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.332152 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.333260 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.335222 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.335956 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.336077 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.336639 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.337321 (+ 682us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.337475 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.337571 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.337665 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 03:18:10.352432 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.350258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56306 (local address 127.18.112.124:36307)
0810 03:18:10.350463 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.350469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.350968 (+ 499us) server_negotiation.cc:407] Connection header received
0810 03:18:10.351162 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.351168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.351279 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.351389 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.352202 (+ 813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56306: BlockingRecv error: recv got EOF from 127.0.0.1:56306 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260810 03:18:10.368098 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.361495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.18.112.125:36085)
0810 03:18:10.361683 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.361689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.362139 (+ 450us) server_negotiation.cc:407] Connection header received
0810 03:18:10.362292 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.362297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.362436 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.362528 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.362943 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.364095 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.365989 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.366690 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.366799 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.367331 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.367483 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.367576 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.367693 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.367770 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 03:18:10.379787 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.377792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56322 (local address 127.18.112.124:36307)
0810 03:18:10.377952 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.377957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.378476 (+ 519us) server_negotiation.cc:407] Connection header received
0810 03:18:10.378613 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.378617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.378717 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.378829 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.379590 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56322: BlockingRecv error: recv got EOF from 127.0.0.1:56322 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:18:10.391098 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.384693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.18.112.125:36085)
0810 03:18:10.384836 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.384842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.385289 (+ 447us) server_negotiation.cc:407] Connection header received
0810 03:18:10.385424 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.385429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.385506 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.385606 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.386048 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.387195 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.389082 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.389778 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.389894 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.390364 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.390506 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.390589 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.390741 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.390814 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 03:18:10.407073 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.405090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.18.112.124:36307)
0810 03:18:10.405257 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.405263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.405729 (+ 466us) server_negotiation.cc:407] Connection header received
0810 03:18:10.405880 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.405886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.405969 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.406082 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.406863 (+ 781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56336: BlockingRecv error: recv got EOF from 127.0.0.1:56336 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:18:10.420863 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.414095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.18.112.125:36085)
0810 03:18:10.414306 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.414311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.414831 (+ 520us) server_negotiation.cc:407] Connection header received
0810 03:18:10.414998 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.415003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.415086 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.415177 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.415641 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.416761 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.418729 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.419403 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.419496 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.420116 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.420245 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.420306 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.420529 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.420605 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
W20260810 03:18:10.445370 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.443388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56344 (local address 127.18.112.124:36307)
0810 03:18:10.443609 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.443615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.443699 (+ 84us) server_negotiation.cc:407] Connection header received
0810 03:18:10.443985 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.443991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.444091 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.444161 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.445141 (+ 980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56344: BlockingRecv error: recv got EOF from 127.0.0.1:56344 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
I20260810 03:18:10.507259 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.488781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59174 (local address 127.18.112.125:36085)
0810 03:18:10.488978 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.488985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.500077 (+ 11092us) server_negotiation.cc:407] Connection header received
0810 03:18:10.500568 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.500575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.500667 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.500729 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.501563 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.502729 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.504918 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.505701 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.505819 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.506400 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.506549 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.506611 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.506835 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.506916 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 03:18:10.549840 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.540583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56358 (local address 127.18.112.124:36307)
0810 03:18:10.540782 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.540789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.548143 (+ 7354us) server_negotiation.cc:407] Connection header received
0810 03:18:10.548304 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.548311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.548410 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.548503 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.549554 (+ 1051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56358: BlockingRecv error: recv got EOF from 127.0.0.1:56358 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:18:10.613965 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.606975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.18.112.125:36085)
0810 03:18:10.607156 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.607162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.607722 (+ 560us) server_negotiation.cc:407] Connection header received
0810 03:18:10.607935 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.607942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.608039 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.608149 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.608620 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.609852 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.611872 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.612533 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.612672 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.613180 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.613322 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.613424 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.613594 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.613683 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 03:18:10.627759 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.625572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.18.112.124:36307)
0810 03:18:10.625747 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.625752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.626256 (+ 504us) server_negotiation.cc:407] Connection header received
0810 03:18:10.626400 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.626406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.626501 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.626613 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.627528 (+ 915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56364: BlockingRecv error: recv got EOF from 127.0.0.1:56364 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:18:10.672297 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.665723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59196 (local address 127.18.112.125:36085)
0810 03:18:10.665917 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.665923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.666427 (+ 504us) server_negotiation.cc:407] Connection header received
0810 03:18:10.666620 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.666626 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.666723 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.666805 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.667253 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.668334 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.670289 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.670937 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.671068 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.671504 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.671644 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.671730 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.671887 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.671964 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 03:18:10.680745 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.679027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56374 (local address 127.18.112.124:36307)
0810 03:18:10.679203 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.679209 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.679228 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:18:10.679488 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.679494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.679592 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.679694 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.680538 (+ 844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56374: BlockingRecv error: recv got EOF from 127.0.0.1:56374 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:18:10.753798 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.748278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.18.112.125:36085)
0810 03:18:10.748471 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.748478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.748995 (+ 517us) server_negotiation.cc:407] Connection header received
0810 03:18:10.749196 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.749200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.749266 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.749346 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.749998 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.750883 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.752273 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.752665 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.752774 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.753159 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.753260 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.753334 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.753476 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.753556 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260810 03:18:10.761852 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:10.760147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56384 (local address 127.18.112.124:36307)
0810 03:18:10.760308 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.760314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.760614 (+ 300us) server_negotiation.cc:407] Connection header received
0810 03:18:10.760766 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.760771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.760844 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.760923 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:10.761658 (+ 735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56384: BlockingRecv error: recv got EOF from 127.0.0.1:56384 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:18:10.811571 20995 catalog_manager.cc:1259] Loaded cluster ID: 911c3d3bd2ea48ca935ce848793fc645
I20260810 03:18:10.811661 20995 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: loading cluster ID for follower catalog manager: success
I20260810 03:18:10.814083 20995 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: acquiring CA information for follower catalog manager: success
I20260810 03:18:10.815747 20995 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d110ea04198b4cb49e7b8a4835dc733a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:18:10.897661 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.893034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.18.112.125:36085)
0810 03:18:10.893209 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.893214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.893526 (+ 312us) server_negotiation.cc:407] Connection header received
0810 03:18:10.893715 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.893719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.893788 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.893865 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.894282 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.894938 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.896205 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.896664 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.896756 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.897085 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.897211 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.897279 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.897379 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.897442 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:18:10.907593 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.902691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56396 (local address 127.18.112.124:36307)
0810 03:18:10.902885 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.902891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.903142 (+ 251us) server_negotiation.cc:407] Connection header received
0810 03:18:10.903264 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.903267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.903421 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.903512 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.903896 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.904587 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.905769 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.906147 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.906232 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.906618 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.907127 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.907244 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.907285 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.907345 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:18:10.920912 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.913140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59224 (local address 127.18.112.125:36085)
0810 03:18:10.913345 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.913351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.915231 (+ 1880us) server_negotiation.cc:407] Connection header received
0810 03:18:10.915422 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.915427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.915507 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.915569 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.916357 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.917229 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.919057 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.919675 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.919779 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.920198 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.920323 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.920399 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.920577 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.920652 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:18:10.920929 21216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.913096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60524 (local address 127.18.112.126:32991)
0810 03:18:10.914173 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.914177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.914192 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:18:10.914280 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.914283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.914413 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.914571 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.915574 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.916526 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.918480 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.919066 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.919175 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.919734 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.920163 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.920268 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.920394 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.920481 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":980,"thread_start_us":877,"threads_started":1}
I20260810 03:18:10.922173 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:10.915316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56412 (local address 127.18.112.124:36307)
0810 03:18:10.915488 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:10.915493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:10.915781 (+ 288us) server_negotiation.cc:407] Connection header received
0810 03:18:10.915970 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:10.915975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:10.916047 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:10.916136 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:10.916645 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.917727 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.919663 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:10.920289 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:10.920391 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:10.921500 (+ 1109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:10.921590 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:10.921664 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:10.921834 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 03:18:10.921932 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:18:10.926214 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20637
I20260810 03:18:10.927172 20747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:11.032778 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20637
I20260810 03:18:11.060596 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20765
I20260810 03:18:11.061714 20859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:11.165198 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20765
I20260810 03:18:11.190745 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 20876
I20260810 03:18:11.191838 20966 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:11.301738 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 20876
2026-08-10T03:18:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4418 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:18:11 dist-test-slave-jlzn krb5kdc[21224](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:18:11 dist-test-slave-jlzn krb5kdc[21224](info): set up 2 sockets
Aug 10 03:18:11 dist-test-slave-jlzn krb5kdc[21224](info): commencing operation
krb5kdc: starting...
W20260810 03:18:12.505101 18881 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/test-user.keytab.
Aug 10 03:18:12 dist-test-slave-jlzn krb5kdc[21224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:18:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:18:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.112.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
Entry for principal kudu/127.18.112.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab.
I20260810 03:18:12.764705 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36021
--webserver_interface=127.18.112.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:18:13.093901 21242 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:13.094209 21242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:13.094316 21242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:13.094434 21242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:13.101387 21242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:13.101473 21242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:13.101560 21242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:13.101626 21242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:13.101713 21242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:13.110988 21242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.126.keytab
--principal=kudu/127.18.112.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.126:36021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.112.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:13.112135 21242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:13.113327 21242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:13.124033 21249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:13.124210 21248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:13.124178 21251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:13.125167 21242 server_base.cc:1034] running on GCE node
I20260810 03:18:13.125866 21242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:13.127056 21242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:13.128268 21242 hybrid_clock.cc:648] HybridClock initialized: now 1786331893128210 us; error 27 us; skew 500 ppm
I20260810 03:18:13.128578 21242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:13.131453 21242 init.cc:377] Logged in from keytab as kudu/127.18.112.126@KRBTEST.COM (short username kudu)
I20260810 03:18:13.132812 21242 webserver.cc:460] Webserver started at http://127.18.112.126:39105/ using document root <none> and password file <none>
I20260810 03:18:13.133419 21242 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:13.133519 21242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:13.133823 21242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:13.136601 21242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data/instance:
uuid: "d57ca6e6e4044a87992edfc7fc4a6691"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "324a4af10224ef4caf697826b58a664c"
server_key_iv: "0e7a64ec6f363277fe682a7d3d771639"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.137326 21242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance:
uuid: "d57ca6e6e4044a87992edfc7fc4a6691"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "324a4af10224ef4caf697826b58a664c"
server_key_iv: "0e7a64ec6f363277fe682a7d3d771639"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.141985 21242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:18:13.145104 21260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:13.146221 21242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:18:13.146380 21242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal
uuid: "d57ca6e6e4044a87992edfc7fc4a6691"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "324a4af10224ef4caf697826b58a664c"
server_key_iv: "0e7a64ec6f363277fe682a7d3d771639"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.146571 21242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:13.163374 21242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:13.166827 21242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:13.167064 21242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:13.183830 21242 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.126:36021
I20260810 03:18:13.183859 21343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.126:36021 every 8 connection(s)
I20260810 03:18:13.184991 21242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/data/info.pb
I20260810 03:18:13.188287 21344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:13.190184 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21242
I20260810 03:18:13.190351 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-0/wal/instance
I20260810 03:18:13.190793 18881 external_mini_cluster.cc:1428] Setting key 186060db280ec5668543520c9fa04c66
I20260810 03:18:13.194458 21344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:13.216188 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.197238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36021 (local address 127.0.0.1:39180)
0810 03:18:13.197996 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.198039 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:13.199934 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:13.200725 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:13.200731 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:13.201403 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:13.201731 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.201749 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.203250 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.203258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.204367 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.204379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.205234 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.205241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.205408 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.206035 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:13.206059 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:13.208613 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:13.212543 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.212553 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.212561 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.212951 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.213409 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.213412 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.213414 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.213559 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.214430 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:13.214435 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:13.214611 (+ 176us) client_negotiation.cc:769] Sending connection context
0810 03:18:13.214811 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 03:18:13.215158 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":302,"threads_started":1}
I20260810 03:18:13.216214 21348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.197239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.18.112.126:36021)
0810 03:18:13.198705 (+ 1466us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:13.198717 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:13.198769 (+ 52us) server_negotiation.cc:407] Connection header received
0810 03:18:13.200263 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:13.200268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:13.200497 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:13.200676 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:13.201924 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.203101 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.204494 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.205017 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.205199 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.208880 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:13.208889 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:13.208903 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:13.208938 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:13.212413 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.213114 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.213122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.213124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.213304 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.213665 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.213670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.213673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.214311 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:13.214544 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:13.214985 (+ 441us) server_negotiation.cc:299] Negotiation successful
0810 03:18:13.215319 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":1273,"thread_start_us":1073,"threads_started":1}
I20260810 03:18:13.218904 21344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:13.220057 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.219665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43802)
0810 03:18:13.219854 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.219956 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 03:18:13.220351 21262 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
I20260810 03:18:13.221818 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.221520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43808)
0810 03:18:13.221636 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.221702 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:18:13.222021 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36961: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.18.112.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
Entry for principal kudu/127.18.112.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab.
I20260810 03:18:13.258669 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:36961
--webserver_interface=127.18.112.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:18:13.271306 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } attempt: 1
I20260810 03:18:13.272408 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.271975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43822)
0810 03:18:13.272157 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.272275 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 03:18:13.273311 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.272974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43824)
0810 03:18:13.273112 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.273187 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:18:13.273475 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36961: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
I20260810 03:18:13.341683 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } attempt: 2
I20260810 03:18:13.342700 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.342259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43830)
0810 03:18:13.342477 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.342562 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 03:18:13.343621 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.343269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43840)
0810 03:18:13.343411 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.343490 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:18:13.343823 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36961: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
I20260810 03:18:13.435030 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } attempt: 3
I20260810 03:18:13.436089 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.435621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43856)
0810 03:18:13.435862 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.435953 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 03:18:13.437040 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.436690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43870)
0810 03:18:13.436834 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.436902 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:18:13.437211 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36961: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
W20260810 03:18:13.575862 21357 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:13.576176 21357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:13.576277 21357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:13.576388 21357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 03:18:13.580430 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } attempt: 4
I20260810 03:18:13.581571 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.581040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43884)
0810 03:18:13.581329 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.581415 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260810 03:18:13.582530 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.582185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43900)
0810 03:18:13.582329 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.582408 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:18:13.582728 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.125:36961: Network error: Client connection negotiation failed: client connection to 127.18.112.125:36961: connect: Connection refused (error 111)
W20260810 03:18:13.583441 21357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:13.583523 21357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:13.583608 21357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:13.583670 21357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:13.583760 21357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:13.592991 21357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.125.keytab
--principal=kudu/127.18.112.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.125:36961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.112.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:13.594139 21357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:18:13.595335 21357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:13.606088 21362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:13.606125 21363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:13.606168 21365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:13.606763 21357 server_base.cc:1034] running on GCE node
I20260810 03:18:13.607448 21357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:13.608733 21357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:13.609941 21357 hybrid_clock.cc:648] HybridClock initialized: now 1786331893609871 us; error 41 us; skew 500 ppm
I20260810 03:18:13.610204 21357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:13.613349 21357 init.cc:377] Logged in from keytab as kudu/127.18.112.125@KRBTEST.COM (short username kudu)
I20260810 03:18:13.614629 21357 webserver.cc:460] Webserver started at http://127.18.112.125:46603/ using document root <none> and password file <none>
I20260810 03:18:13.615221 21357 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:13.615304 21357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:13.615568 21357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:13.618371 21357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data/instance:
uuid: "a8633655a10c4a9da55cb6b66fb19322"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "9cd0bc733f88d63380ea57c1fadffa22"
server_key_iv: "a66ba4e76c2fdf111b3ceac9ef4c7131"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.619107 21357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal/instance:
uuid: "a8633655a10c4a9da55cb6b66fb19322"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "9cd0bc733f88d63380ea57c1fadffa22"
server_key_iv: "a66ba4e76c2fdf111b3ceac9ef4c7131"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.623970 21357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260810 03:18:13.627076 21375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:13.628345 21357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:18:13.628509 21357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal
uuid: "a8633655a10c4a9da55cb6b66fb19322"
format_stamp: "Formatted at 2026-08-10 03:18:13 on dist-test-slave-jlzn"
server_key: "9cd0bc733f88d63380ea57c1fadffa22"
server_key_iv: "a66ba4e76c2fdf111b3ceac9ef4c7131"
server_key_version: "encryptionkey@0"
I20260810 03:18:13.628697 21357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:13.655853 21357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:13.659781 21357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:13.660056 21357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:13.676985 21357 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.125:36961
I20260810 03:18:13.677007 21453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.125:36961 every 8 connection(s)
I20260810 03:18:13.678148 21357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/data/info.pb
I20260810 03:18:13.681504 21455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:13.682580 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21357
I20260810 03:18:13.682758 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-1/wal/instance
I20260810 03:18:13.683192 18881 external_mini_cluster.cc:1428] Setting key b6fa965915a2fc19aac07debd0f5d008
I20260810 03:18:13.687572 21455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:13.707726 21348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.689887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39192 (local address 127.18.112.126:36021)
0810 03:18:13.690081 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:13.690088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:13.691203 (+ 1115us) server_negotiation.cc:407] Connection header received
0810 03:18:13.693464 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:13.693468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:13.693536 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:13.693621 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:13.695379 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.696078 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.697828 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.698413 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.698536 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.701973 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:13.701978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:13.701982 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:13.702025 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:13.704715 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.705514 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.705517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.705520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.705636 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.706102 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.706104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.706106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.706362 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:13.706470 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:13.707312 (+ 842us) server_negotiation.cc:299] Negotiation successful
0810 03:18:13.707479 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:18:13.709060 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.690314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36021 (local address 127.0.0.1:39192)
0810 03:18:13.691026 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.691074 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:13.693204 (+ 2130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:13.693855 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:13.693865 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:13.694530 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:13.695229 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.695254 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.696242 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.696247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.697677 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.697690 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.698609 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.698614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.698802 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.699389 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:13.699416 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:13.701738 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:13.704850 (+ 3112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.704858 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.704871 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.705399 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.705748 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.705753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.705757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.706007 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.706482 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:13.706489 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:13.706902 (+ 413us) client_negotiation.cc:769] Sending connection context
0810 03:18:13.707226 (+ 324us) client_negotiation.cc:240] Negotiation successful
0810 03:18:13.707672 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":273,"threads_started":1}
I20260810 03:18:13.710680 21455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.112.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.112.124@KRBTEST.COM" created.
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:13.725035 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.711584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43904)
0810 03:18:13.711828 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.711853 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:13.712038 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:13.712697 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:13.712702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:13.713170 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:13.713335 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.713347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.715269 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.715273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.716322 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.716338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.717278 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.717282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.717407 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.717915 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:13.717932 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:13.719918 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:13.722757 (+ 2839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.722762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.722766 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.723084 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.723448 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.723453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.723457 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.723576 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.724162 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:13.724167 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:13.724306 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 03:18:13.724413 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 03:18:13.724660 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 03:18:13.725152 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.711491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.18.112.125:36961)
0810 03:18:13.712222 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:13.712230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:13.712262 (+ 32us) server_negotiation.cc:407] Connection header received
0810 03:18:13.712316 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:13.712324 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:13.712542 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:13.712704 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:13.713528 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.715135 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.716469 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.717144 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.717241 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.720112 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:13.720123 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:13.720135 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:13.720167 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:13.722625 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.723216 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.723222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.723224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.723334 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.723680 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.723684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.723686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.724049 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:13.724249 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:13.724580 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 03:18:13.724800 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":360,"threads_started":1}
I20260810 03:18:13.727165 21455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:13.728322 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.727895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59490)
0810 03:18:13.728042 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.728169 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:18:13.728628 21380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:13.730091 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.729773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59504)
0810 03:18:13.729922 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.729994 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:18:13.730294 21455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
Entry for principal kudu/127.18.112.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab.
I20260810 03:18:13.752687 18881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
/tmp/dist-test-taskJGLf1q/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:39613
--webserver_interface=127.18.112.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.112.84:44223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:18:13.779569 21455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 1
I20260810 03:18:13.780601 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.780170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59506)
0810 03:18:13.780359 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.780455 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 03:18:13.781579 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.781250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59514)
0810 03:18:13.781397 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.781472 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:18:13.781761 21455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:13.849952 21455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 2
I20260810 03:18:13.850966 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.850550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59518)
0810 03:18:13.850733 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.850819 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 03:18:13.852002 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.851652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59530)
0810 03:18:13.851784 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.851888 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:18:13.852214 21455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:13.881948 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } attempt: 5
Aug 10 03:18:13 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:13.895463 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.882575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43920)
0810 03:18:13.882774 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.882794 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:13.882904 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:13.883246 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:13.883249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:13.883603 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:13.883783 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.883792 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.885174 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.885177 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.886007 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:13.886018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.886921 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.886925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:13.887079 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.887669 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:13.887685 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:13.889658 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:13.893253 (+ 3595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.893257 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.893259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.893596 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.893943 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:13.893946 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:13.893948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:13.894077 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:13.894571 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:13.894576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:13.894714 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 03:18:13.894836 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 03:18:13.895092 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 03:18:13.895462 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.882726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43920 (local address 127.18.112.125:36961)
0810 03:18:13.882910 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:13.882916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:13.882939 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:18:13.883001 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:13.883007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:13.883106 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:13.883218 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:13.883963 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.885061 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.886152 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:13.886798 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:13.886924 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:13.889848 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:13.889855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:13.889859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:13.889898 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:13.893114 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.893714 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.893719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.893721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.893837 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:13.894175 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:13.894180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:13.894183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:13.894457 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:13.894582 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:13.894953 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 03:18:13.895152 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:18:13.896588 21344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:18:13.897543 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.897206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59540)
0810 03:18:13.897352 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.897418 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:18:13.898432 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.898131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59546)
0810 03:18:13.898257 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.898327 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:18:13.898623 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:13.943405 21455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 3
I20260810 03:18:13.944470 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.944037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59560)
0810 03:18:13.944235 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.944322 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 03:18:13.945528 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.945118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59576)
0810 03:18:13.945340 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.945414 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260810 03:18:13.945747 21455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:13.949817 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 1
I20260810 03:18:13.950707 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.950301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59592)
0810 03:18:13.950444 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.950529 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:18:13.951545 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:13.951240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59600)
0810 03:18:13.951374 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:13.951437 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 03:18:13.951740 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:14.019976 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 2
I20260810 03:18:14.021009 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.020550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59606)
0810 03:18:14.020757 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.020854 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 03:18:14.021925 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.021585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59618)
0810 03:18:14.021754 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.021822 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:18:14.022109 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
W20260810 03:18:14.072788 21465 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:18:14.073077 21465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:18:14.073177 21465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:18:14.073288 21465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:18:14.080132 21465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:18:14.080221 21465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:18:14.080305 21465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:18:14.080365 21465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:18:14.080448 21465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:18:14.088932 21455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 4
I20260810 03:18:14.089840 21465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.112.84:44223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.112.126:36021,127.18.112.125:36961,127.18.112.124:39613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/krb5kdc/kudu_127.18.112.124.keytab
--principal=kudu/127.18.112.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.112.124:39613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.112.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 02:17:12 UTC on ccycloud.quasar-zbrcpm.root.comops.site
build id 4576981
ASAN enabled
I20260810 03:18:14.089954 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.089517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59624)
0810 03:18:14.089719 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.089803 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 03:18:14.090865 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.090556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59640)
0810 03:18:14.090699 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.090767 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:18:14.090940 21465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260810 03:18:14.091071 21455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:14.092247 21465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:18:14.102762 21473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:14.102789 21470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:18:14.102813 21471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:18:14.103838 21465 server_base.cc:1034] running on GCE node
I20260810 03:18:14.104548 21465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:18:14.105723 21465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:18:14.106937 21465 hybrid_clock.cc:648] HybridClock initialized: now 1786331894106868 us; error 37 us; skew 500 ppm
I20260810 03:18:14.107228 21465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331894, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:18:14.110073 21465 init.cc:377] Logged in from keytab as kudu/127.18.112.124@KRBTEST.COM (short username kudu)
I20260810 03:18:14.111384 21465 webserver.cc:460] Webserver started at http://127.18.112.124:45535/ using document root <none> and password file <none>
I20260810 03:18:14.112066 21465 fs_manager.cc:359] Metadata directory not provided
I20260810 03:18:14.112177 21465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:18:14.112462 21465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:18:14.115159 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data/instance:
uuid: "4edb80ca787f4aeb9900db5bfcdb922f"
format_stamp: "Formatted at 2026-08-10 03:18:14 on dist-test-slave-jlzn"
server_key: "6685f3274cdba0b6981f43276ec86583"
server_key_iv: "0a4da22a6f88a94be3dd7f84372cab79"
server_key_version: "encryptionkey@0"
I20260810 03:18:14.115940 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal/instance:
uuid: "4edb80ca787f4aeb9900db5bfcdb922f"
format_stamp: "Formatted at 2026-08-10 03:18:14 on dist-test-slave-jlzn"
server_key: "6685f3274cdba0b6981f43276ec86583"
server_key_iv: "0a4da22a6f88a94be3dd7f84372cab79"
server_key_version: "encryptionkey@0"
I20260810 03:18:14.120698 21465 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:18:14.123769 21481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:18:14.124965 21465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:18:14.125123 21465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data,/tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal
uuid: "4edb80ca787f4aeb9900db5bfcdb922f"
format_stamp: "Formatted at 2026-08-10 03:18:14 on dist-test-slave-jlzn"
server_key: "6685f3274cdba0b6981f43276ec86583"
server_key_iv: "0a4da22a6f88a94be3dd7f84372cab79"
server_key_version: "encryptionkey@0"
I20260810 03:18:14.125313 21465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:18:14.128283 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 3
I20260810 03:18:14.129236 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.128771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59656)
0810 03:18:14.128963 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.129053 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:18:14.130298 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.129901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59658)
0810 03:18:14.130121 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.130201 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260810 03:18:14.130524 21344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.112.124:39613: Network error: Client connection negotiation failed: client connection to 127.18.112.124:39613: connect: Connection refused (error 111)
I20260810 03:18:14.154671 21465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:18:14.158196 21465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:18:14.158422 21465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:18:14.174755 21465 rpc_server.cc:307] RPC server started. Bound to: 127.18.112.124:39613
I20260810 03:18:14.174777 21562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.112.124:39613 every 8 connection(s)
I20260810 03:18:14.175911 21465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/data/info.pb
I20260810 03:18:14.177835 18881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu as pid 21465
I20260810 03:18:14.178000 18881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJGLf1q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786331536832683-18881-0/minicluster-data/master-2/wal/instance
I20260810 03:18:14.178411 18881 external_mini_cluster.cc:1428] Setting key 4cafd90d66f18a9cb235690d44e24fa9
I20260810 03:18:14.179525 21563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:18:14.188409 21563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331894, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
I20260810 03:18:14.201998 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.179993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59670 (local address 127.18.112.124:39613)
0810 03:18:14.180789 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.180803 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.180849 (+ 46us) server_negotiation.cc:407] Connection header received
0810 03:18:14.182618 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.182645 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.183106 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.183505 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.185209 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.187156 (+ 1947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.188952 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.189902 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.190076 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.194689 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.194697 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.194706 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.194738 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.198277 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.198946 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.198955 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.198963 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.199198 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.199575 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.199578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.199580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.200074 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.200293 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.200710 (+ 417us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.201025 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"spinlock_wait_cycles":15104,"thread_start_us":337,"threads_started":1}
I20260810 03:18:14.204707 21568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.190888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.126:36021 (local address 127.0.0.1:39206)
0810 03:18:14.191701 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.191746 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:14.191963 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:14.192320 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:14.192327 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:14.192866 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:14.193092 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.193109 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.194106 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.194112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.195366 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.195382 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.196084 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.196088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.196245 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.196808 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:14.196832 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:14.199030 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:14.202237 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.202246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.202251 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.202646 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.203004 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.203007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.203009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.203142 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.203637 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:14.203644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:14.203859 (+ 215us) client_negotiation.cc:769] Sending connection context
0810 03:18:14.204037 (+ 178us) client_negotiation.cc:240] Negotiation successful
0810 03:18:14.204302 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":443,"threads_started":1}
I20260810 03:18:14.204766 21348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.190939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39206 (local address 127.18.112.126:36021)
0810 03:18:14.191167 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.191175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.191845 (+ 670us) server_negotiation.cc:407] Connection header received
0810 03:18:14.192090 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.192096 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.192166 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.192248 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.193249 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.193956 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.195492 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.195940 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.196036 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.199207 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.199212 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.199215 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.199248 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.202086 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.202756 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.202761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.202765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.202901 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.203243 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.203249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.203252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.203506 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.203647 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.204164 (+ 517us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.204367 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:18:14.206290 21563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.126@KRBTEST.COM
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331894, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:14.220029 21568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.206819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.125:36961 (local address 127.0.0.1:43932)
0810 03:18:14.206964 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.206980 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:14.207064 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:14.207330 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:14.207334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:14.207739 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:14.207912 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.207923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.209155 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.209159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.210302 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.210317 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.211408 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.211414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.211630 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.212227 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:14.212249 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:14.214644 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:14.217596 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.217601 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.217605 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.218045 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.218400 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.218405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.218408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.218561 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.219111 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:14.219116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:14.219282 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 03:18:14.219431 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 03:18:14.219692 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 03:18:14.220147 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.206947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43932 (local address 127.18.112.125:36961)
0810 03:18:14.207094 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.207098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.207112 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:18:14.207167 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.207171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.207224 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.207296 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.208052 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.209044 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.210492 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.211103 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.211219 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.214819 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.214824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.214827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.214860 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.217497 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.218154 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.218159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.218162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.218302 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.218666 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.218669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.218673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.218995 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.219156 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.219559 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.219768 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 03:18:14.220168 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.204441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.18.112.126:36021)
0810 03:18:14.204985 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.204990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.205013 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:18:14.205130 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.205143 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.205203 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.205284 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.206504 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.207561 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.209144 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.209742 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.209866 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.215043 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.215047 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.215050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.215079 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.217393 (+ 2314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.218125 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.218130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.218133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.218280 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.218674 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.218679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.218682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.219006 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.219241 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.219551 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.219771 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":250,"threads_started":1}
I20260810 03:18:14.221356 21563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331894, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.124@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.112.125@KRBTEST.COM
I20260810 03:18:14.233283 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.222258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59676 (local address 127.18.112.124:39613)
0810 03:18:14.222379 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.222383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.222395 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:18:14.222429 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.222432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.222477 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.222544 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.223301 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.223981 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.225036 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.225410 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.225508 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.228177 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.228181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.228184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.228210 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.230764 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.231470 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.231474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.231476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.231618 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.232047 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.232050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.232052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.232291 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.232392 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.232771 (+ 379us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.232942 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:18:14.233793 21568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.222060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59676)
0810 03:18:14.222211 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.222228 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:14.222314 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:14.222598 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:14.222602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:14.223010 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:14.223176 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.223188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.224091 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.224096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.224915 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.224926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.225548 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.225554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.225740 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.226202 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:14.226217 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:14.228025 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:14.230888 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.230894 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.230897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.231364 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.231729 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.231734 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.231738 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.231943 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.232391 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:14.232396 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:14.232544 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 03:18:14.232709 (+ 165us) client_negotiation.cc:240] Negotiation successful
0810 03:18:14.233560 (+ 851us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":581}
I20260810 03:18:14.235371 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.221653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43934 (local address 127.18.112.125:36961)
0810 03:18:14.221800 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.221806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.221822 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:18:14.221926 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.221931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.221997 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.222087 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.223486 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.224217 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.225363 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.225770 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.225871 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.229924 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.229929 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.229933 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.229961 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.232844 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.233570 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.233576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.233580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.233725 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.234108 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.234113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.234115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.234425 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.234694 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.234890 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.235061 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:18:14.238910 21563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: Bootstrap starting.
I20260810 03:18:14.239702 18881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:18:14.242159 21563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:14.243387 21563 log.cc:824] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:14.241911 21301 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d57ca6e6e4044a87992edfc7fc4a6691"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39208
I20260810 03:18:14.246340 21563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: No bootstrap required, opened a new log
I20260810 03:18:14.253489 21563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.253780 21563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4edb80ca787f4aeb9900db5bfcdb922f, State: Initialized, Role: FOLLOWER
I20260810 03:18:14.254240 21563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.255134 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.255430 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.256223 21563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:18:14.264916 21591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:18:14.265039 21591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:18:14.262676 21465 master_runner.cc:186] Error getting master registration for 127.18.112.126:36021: OK, instance_id { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" instance_seqno: 1786331893179079 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:18:14.273120 21465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:18:14.307760 21344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 4
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.126@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:18:14.323331 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.308392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59688)
0810 03:18:14.308574 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.308594 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:14.308693 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:14.309001 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:14.309006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:14.309499 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:14.309707 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.309719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.311058 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.311063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.312554 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.312568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.313541 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.313546 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.313735 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.314374 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:14.314408 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:14.316960 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:14.320775 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.320779 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.320782 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.321246 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.321622 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.321633 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.321637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.321804 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.322400 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:14.322405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:14.322558 (+ 153us) client_negotiation.cc:769] Sending connection context
0810 03:18:14.322703 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 03:18:14.322960 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 03:18:14.323374 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.308462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59688 (local address 127.18.112.124:39613)
0810 03:18:14.308678 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.308684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.308706 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:18:14.308790 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.308796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.308869 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.308960 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.309852 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.310944 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.312694 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.313407 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.313540 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.317130 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.317144 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.317149 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.317186 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.320646 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.321363 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.321369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.321376 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.321518 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.321906 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.321911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.321914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.322287 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.322473 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.322812 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.323021 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 03:18:14.328959 21344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: Bootstrap starting.
I20260810 03:18:14.332245 21344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:14.333360 21344 log.cc:824] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:14.336027 21344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: No bootstrap required, opened a new log
I20260810 03:18:14.343124 21344 raft_consensus.cc:348] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.343492 21344 raft_consensus.cc:729] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57ca6e6e4044a87992edfc7fc4a6691, State: Initialized, Role: FOLLOWER
I20260810 03:18:14.343984 21344 consensus_queue.cc:260] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.344873 21595 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.345281 21595 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.345954 21344 sys_catalog.cc:564] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:14.346045 21301 raft_consensus.cc:482] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 03:18:14.346246 21301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:14.349453 21301 raft_consensus.cc:504] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.351634 21526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4edb80ca787f4aeb9900db5bfcdb922f"
I20260810 03:18:14.352097 21526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:14.355423 21526 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d57ca6e6e4044a87992edfc7fc4a6691 in term 1.
I20260810 03:18:14.356027 21266 leader_election.cc:302] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4edb80ca787f4aeb9900db5bfcdb922f, d57ca6e6e4044a87992edfc7fc4a6691; no voters:
I20260810 03:18:14.356374 21301 leader_election.cc:288] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [CANDIDATE]: Term 1 election: Requested vote from peers a8633655a10c4a9da55cb6b66fb19322 (127.18.112.125:36961), 4edb80ca787f4aeb9900db5bfcdb922f (127.18.112.124:39613)
I20260810 03:18:14.356460 21595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:18:14.368108 21595 raft_consensus.cc:686] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [term 1 LEADER]: Becoming Leader. State: Replica: d57ca6e6e4044a87992edfc7fc4a6691, State: Running, Role: LEADER
I20260810 03:18:14.369160 21595 consensus_queue.cc:237] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.382057 21606 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57ca6e6e4044a87992edfc7fc4a6691. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.382470 21606 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:14.383864 21618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:18:14.390214 21455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } attempt: 5
I20260810 03:18:14.394804 21618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 03:18:14 dist-test-slave-jlzn krb5kdc[21224](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786331893, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.112.125@KRBTEST.COM for kudu/127.18.112.124@KRBTEST.COM
I20260810 03:18:14.409372 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.390801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.112.124:39613 (local address 127.0.0.1:59702)
0810 03:18:14.391191 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 03:18:14.391211 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:18:14.391324 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:18:14.392680 (+ 1356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:18:14.392686 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:18:14.393276 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:18:14.393492 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.393505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.395106 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.395112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.396579 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:18:14.396595 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.397720 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.397726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:18:14.397958 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.398608 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:18:14.398632 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:18:14.402558 (+ 3926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:18:14.406595 (+ 4037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.406600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.406605 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.407074 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.407509 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:18:14.407514 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:18:14.407517 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:18:14.407706 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:18:14.408400 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:18:14.408405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:18:14.408553 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 03:18:14.408694 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 03:18:14.408960 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250}
W20260810 03:18:14.410245 21492 tablet.cc:2369] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:18:14.410322 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.391541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59702 (local address 127.18.112.124:39613)
0810 03:18:14.392037 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.392042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.392061 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:18:14.392112 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.392117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.392203 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.392304 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.393826 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.394938 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.396766 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.397416 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.397531 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.402777 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.402784 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.402788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.402824 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.406439 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.407223 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.407229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.407232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.407383 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.407859 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.407864 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.407868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.408200 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.408338 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.409725 (+ 1387us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.409938 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380}
I20260810 03:18:14.416476 21526 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [term 1 FOLLOWER]: Refusing update from remote peer d57ca6e6e4044a87992edfc7fc4a6691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:18:14.417395 21595 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:18:14.419405 21271 tablet.cc:2369] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:18:14.421900 21455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: Bootstrap starting.
I20260810 03:18:14.425746 21455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: Neither blocks nor log segments found. Creating new log.
I20260810 03:18:14.426983 21455 log.cc:824] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: Log is configured to *not* fsync() on all Append() calls
I20260810 03:18:14.436553 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57ca6e6e4044a87992edfc7fc4a6691. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.436852 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.439635 21455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: No bootstrap required, opened a new log
I20260810 03:18:14.440775 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.392006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39224 (local address 127.18.112.126:36021)
0810 03:18:14.392162 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.392167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.392570 (+ 403us) server_negotiation.cc:407] Connection header received
0810 03:18:14.392990 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.392996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.393070 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.393156 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.400388 (+ 7232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.401466 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.408520 (+ 7054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.409242 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.409347 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.424588 (+ 15241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.424595 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.424601 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.424643 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.428439 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.436176 (+ 7737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.436182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.436186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.436334 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.438275 (+ 1941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.438280 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.438282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.438625 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.438848 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.440246 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.440477 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:18:14.441820 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.392543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43936 (local address 127.18.112.125:36961)
0810 03:18:14.393737 (+ 1194us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.393742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.394958 (+ 1216us) server_negotiation.cc:407] Connection header received
0810 03:18:14.395630 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.395636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.395715 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.395793 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.403675 (+ 7882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.404720 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.411956 (+ 7236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.412619 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.412714 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.428780 (+ 16066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.428787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.428792 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.428831 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.432768 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.435812 (+ 3044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.435819 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.435822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.435987 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.437514 (+ 1527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.437519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.437522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.437911 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.438155 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.441183 (+ 3028us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.441425 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1079}
I20260810 03:18:14.457752 21606 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.457981 21618 catalog_manager.cc:1347] Generated new cluster ID: bcc251bdaba34ce894929cd4f150ccdb
I20260810 03:18:14.458038 21606 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:14.458072 21618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:18:14.441138 21242 master_runner.cc:186] Error getting master registration for 127.18.112.125:36961: OK, instance_id { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" instance_seqno: 1786331893672275 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:18:14.462898 21455 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.463231 21455 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8633655a10c4a9da55cb6b66fb19322, State: Initialized, Role: FOLLOWER
I20260810 03:18:14.463719 21455 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } }
I20260810 03:18:14.467783 21242 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:18:14.470587 21636 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.470976 21636 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.472556 21455 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:18:14.472926 21411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:18:14.475708 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.475966 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.476946 21412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a8633655a10c4a9da55cb6b66fb19322"
I20260810 03:18:14.479611 21411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [term 1 FOLLOWER]: Refusing update from remote peer d57ca6e6e4044a87992edfc7fc4a6691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:18:14.485555 21412 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d57ca6e6e4044a87992edfc7fc4a6691 in term 1.
I20260810 03:18:14.485702 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.432979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59714 (local address 127.18.112.124:39613)
0810 03:18:14.433481 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.433487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.444220 (+ 10733us) server_negotiation.cc:407] Connection header received
0810 03:18:14.444572 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.444605 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.444747 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.444874 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.447946 (+ 3072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.449612 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.452887 (+ 3275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.453977 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.454117 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.465638 (+ 11521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:18:14.465645 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:18:14.465650 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:18:14.465686 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:18:14.469246 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.472587 (+ 3341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.472593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.472597 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.472751 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:18:14.483911 (+ 11160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:18:14.483917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:18:14.483920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:18:14.484296 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:18:14.484549 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.485098 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.485354 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231}
I20260810 03:18:14.488122 21606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:18:14.494494 21618 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:18:14.496238 21618 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:18:14.513484 21618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691: Generated new TSK 0
I20260810 03:18:14.514496 21618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:18:14.534328 21636 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57ca6e6e4044a87992edfc7fc4a6691. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.534610 21636 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.534716 21595 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.534977 21595 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57ca6e6e4044a87992edfc7fc4a6691 [sys.catalog]: This master's current role is: LEADER
I20260810 03:18:14.534950 21651 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d57ca6e6e4044a87992edfc7fc4a6691" member_type: VOTER last_known_addr { host: "127.18.112.126" port: 36021 } } peers { permanent_uuid: "a8633655a10c4a9da55cb6b66fb19322" member_type: VOTER last_known_addr { host: "127.18.112.125" port: 36961 } } peers { permanent_uuid: "4edb80ca787f4aeb9900db5bfcdb922f" member_type: VOTER last_known_addr { host: "127.18.112.124" port: 39613 } } }
I20260810 03:18:14.535260 21651 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:18:14.553797 21659 catalog_manager.cc:1259] Loaded cluster ID: bcc251bdaba34ce894929cd4f150ccdb
I20260810 03:18:14.553951 21659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: loading cluster ID for follower catalog manager: success
I20260810 03:18:14.557977 21659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: acquiring CA information for follower catalog manager: success
I20260810 03:18:14.560333 21659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a8633655a10c4a9da55cb6b66fb19322: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 03:18:14.673187 21570 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.647611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.18.112.126:36021)
0810 03:18:14.647840 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.647847 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.671156 (+ 23309us) server_negotiation.cc:407] Connection header received
0810 03:18:14.671468 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.671475 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.671590 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.671675 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.672892 (+ 1217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39240: BlockingRecv error: recv got EOF from 127.0.0.1:39240 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260810 03:18:14.676254 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.664993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59716 (local address 127.18.112.124:39613)
0810 03:18:14.665161 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.665167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.674407 (+ 9240us) server_negotiation.cc:407] Connection header received
0810 03:18:14.674669 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.674675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.674773 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.674852 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.676002 (+ 1150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59716: BlockingRecv error: recv got EOF from 127.0.0.1:59716 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 03:18:14.678071 21460 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.653319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43946 (local address 127.18.112.125:36961)
0810 03:18:14.653523 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.653531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.674066 (+ 20535us) server_negotiation.cc:407] Connection header received
0810 03:18:14.676643 (+ 2577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.676653 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.676761 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.676838 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.677835 (+ 997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43946: BlockingRecv error: recv got EOF from 127.0.0.1:43946 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:18:14.723713 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.703058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43948 (local address 127.18.112.125:36961)
0810 03:18:14.703234 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.703239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.715562 (+ 12323us) server_negotiation.cc:407] Connection header received
0810 03:18:14.716067 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.716072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.716274 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.716413 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.717151 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.718297 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.720296 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.720945 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.721069 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.722189 (+ 1120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.722880 (+ 691us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.723001 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.723261 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.723361 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 03:18:14.775399 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.763188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59732 (local address 127.18.112.124:39613)
0810 03:18:14.763351 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.763357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.773398 (+ 10041us) server_negotiation.cc:407] Connection header received
0810 03:18:14.773729 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.773736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.773918 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.774010 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.775149 (+ 1139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59732: BlockingRecv error: recv got EOF from 127.0.0.1:59732 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 03:18:14.826534 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.808667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43958 (local address 127.18.112.125:36961)
0810 03:18:14.808835 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.808842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.819420 (+ 10578us) server_negotiation.cc:407] Connection header received
0810 03:18:14.819875 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.819882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.819991 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.820065 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.820726 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.821884 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.823941 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.824658 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.824745 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.825670 (+ 925us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.825825 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.825888 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.826138 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.826231 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 03:18:14.849136 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.847075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.18.112.124:39613)
0810 03:18:14.847295 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.847302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.847763 (+ 461us) server_negotiation.cc:407] Connection header received
0810 03:18:14.847974 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.847980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.848053 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.848134 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.848903 (+ 769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59748: BlockingRecv error: recv got EOF from 127.0.0.1:59748 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:18:14.859331 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.853584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43966 (local address 127.18.112.125:36961)
0810 03:18:14.853764 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.853770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.854242 (+ 472us) server_negotiation.cc:407] Connection header received
0810 03:18:14.854393 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.854398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.854478 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.854559 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.855039 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.855968 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.857420 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.857986 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.858125 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.858503 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.858662 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.858735 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.858886 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.858963 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260810 03:18:14.885576 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.877224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59760 (local address 127.18.112.124:39613)
0810 03:18:14.877407 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.877413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.884332 (+ 6919us) server_negotiation.cc:407] Connection header received
0810 03:18:14.884495 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.884501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.884582 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.884668 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.885401 (+ 733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59760: BlockingRecv error: recv got EOF from 127.0.0.1:59760 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:18:14.899266 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.893019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43968 (local address 127.18.112.125:36961)
0810 03:18:14.893259 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.893265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.893737 (+ 472us) server_negotiation.cc:407] Connection header received
0810 03:18:14.893890 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.893895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.893964 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.894051 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.894440 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.895187 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.896938 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.897662 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.897770 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.898430 (+ 660us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.898590 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.898659 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.898912 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.898995 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
W20260810 03:18:14.919665 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.917652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59764 (local address 127.18.112.124:39613)
0810 03:18:14.917926 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.917933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.918395 (+ 462us) server_negotiation.cc:407] Connection header received
0810 03:18:14.918568 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.918574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.918661 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.918748 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.919466 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59764: BlockingRecv error: recv got EOF from 127.0.0.1:59764 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
I20260810 03:18:14.936282 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.930477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.18.112.125:36961)
0810 03:18:14.930810 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.930817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.931426 (+ 609us) server_negotiation.cc:407] Connection header received
0810 03:18:14.931613 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.931618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.931704 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.931820 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.932230 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.933155 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.934503 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.934989 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.935113 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.935495 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.935603 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.935676 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.935877 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.935952 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260810 03:18:14.949684 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.947712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59770 (local address 127.18.112.124:39613)
0810 03:18:14.947926 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.947932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.948408 (+ 476us) server_negotiation.cc:407] Connection header received
0810 03:18:14.948563 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.948569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.948644 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.948724 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.949465 (+ 741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59770: BlockingRecv error: recv got EOF from 127.0.0.1:59770 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:18:14.973395 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:14.968210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43996 (local address 127.18.112.125:36961)
0810 03:18:14.968381 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.968387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.968829 (+ 442us) server_negotiation.cc:407] Connection header received
0810 03:18:14.968997 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.969001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.969069 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.969157 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:14.969555 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.970359 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.971674 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:14.972204 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:14.972336 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:14.972714 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:14.972819 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:14.972891 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:14.973031 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 03:18:14.973124 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 03:18:14.980502 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:14.978497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59772 (local address 127.18.112.124:39613)
0810 03:18:14.978667 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:14.978671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:14.979289 (+ 618us) server_negotiation.cc:407] Connection header received
0810 03:18:14.979441 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:14.979447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:14.979517 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:14.979595 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:14.980347 (+ 752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59772: BlockingRecv error: recv got EOF from 127.0.0.1:59772 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:18:15.022817 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.017481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44006 (local address 127.18.112.125:36961)
0810 03:18:15.017705 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.017714 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.018254 (+ 540us) server_negotiation.cc:407] Connection header received
0810 03:18:15.018441 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.018445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.018530 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.018614 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.019033 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.019821 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.021147 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.021623 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.021743 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.022123 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.022234 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.022307 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.022441 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.022519 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260810 03:18:15.029888 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:15.028000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.18.112.124:39613)
0810 03:18:15.028212 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.028217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.028526 (+ 309us) server_negotiation.cc:407] Connection header received
0810 03:18:15.028699 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.028703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.028783 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.028862 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:15.029656 (+ 794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59784: BlockingRecv error: recv got EOF from 127.0.0.1:59784 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260810 03:18:15.101357 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.096984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.18.112.125:36961)
0810 03:18:15.097194 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.097200 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.097463 (+ 263us) server_negotiation.cc:407] Connection header received
0810 03:18:15.097604 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.097607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.097683 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.097756 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.098079 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.098781 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.100020 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.100400 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.100488 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.100782 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.100886 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.100947 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.101037 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.101093 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260810 03:18:15.107487 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:15.105999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59790 (local address 127.18.112.124:39613)
0810 03:18:15.106203 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.106208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.106451 (+ 243us) server_negotiation.cc:407] Connection header received
0810 03:18:15.106576 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.106580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.106668 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.106742 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:15.107292 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59790: BlockingRecv error: recv got EOF from 127.0.0.1:59790 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:18:15.242717 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.238366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44026 (local address 127.18.112.125:36961)
0810 03:18:15.238598 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.238603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.238867 (+ 264us) server_negotiation.cc:407] Connection header received
0810 03:18:15.239029 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.239033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.239101 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.239180 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.239511 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.240201 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.241389 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.241756 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.241839 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.242137 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.242233 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.242291 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.242384 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.242443 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260810 03:18:15.249758 21567 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:18:15.248049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.18.112.124:39613)
0810 03:18:15.248243 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.248249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.248742 (+ 493us) server_negotiation.cc:407] Connection header received
0810 03:18:15.248864 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.248867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.248934 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.249009 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:18:15.249584 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59792: BlockingRecv error: recv got EOF from 127.0.0.1:59792 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:18:15.266914 21591 catalog_manager.cc:1259] Loaded cluster ID: bcc251bdaba34ce894929cd4f150ccdb
I20260810 03:18:15.266999 21591 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: loading cluster ID for follower catalog manager: success
I20260810 03:18:15.269425 21591 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: acquiring CA information for follower catalog manager: success
I20260810 03:18:15.271101 21591 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4edb80ca787f4aeb9900db5bfcdb922f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:18:15.513979 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.509050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44032 (local address 127.18.112.125:36961)
0810 03:18:15.509217 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.509221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.509487 (+ 266us) server_negotiation.cc:407] Connection header received
0810 03:18:15.509642 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.509646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.509714 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.509821 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.510149 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.510897 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.512319 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.512706 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.512843 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.513243 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.513376 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.513468 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.513651 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.513723 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:18:15.523954 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.519104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.18.112.124:39613)
0810 03:18:15.519255 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.519259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.519499 (+ 240us) server_negotiation.cc:407] Connection header received
0810 03:18:15.519641 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.519644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.519786 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.519902 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.520210 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.520865 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.522104 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.522465 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.522581 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.522968 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.523477 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.523584 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.523620 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.523685 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:18:15.548929 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.529505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.18.112.125:36961)
0810 03:18:15.529692 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.529698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.542566 (+ 12868us) server_negotiation.cc:407] Connection header received
0810 03:18:15.542894 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.542899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.542978 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.543026 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.543786 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.544767 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.546916 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.547532 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.547656 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.548238 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.548344 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.548419 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.548555 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.548629 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:18:15.549700 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.529245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.18.112.126:36021)
0810 03:18:15.541901 (+ 12656us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.541907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.542867 (+ 960us) server_negotiation.cc:407] Connection header received
0810 03:18:15.543180 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.543186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.543404 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.543582 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.544179 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.544898 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.546879 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.547595 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.547709 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.548400 (+ 691us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.548853 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.548949 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.549353 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.549431 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12523,"thread_start_us":12663,"threads_started":1}
I20260810 03:18:15.550053 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:18:15.529267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.18.112.124:39613)
0810 03:18:15.529431 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:18:15.529437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:18:15.543086 (+ 13649us) server_negotiation.cc:407] Connection header received
0810 03:18:15.543292 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:18:15.543296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:18:15.543357 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:18:15.543426 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:18:15.544122 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.545109 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.547179 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:18:15.547601 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:18:15.547731 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:18:15.548376 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:18:15.548500 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:18:15.548562 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:18:15.549691 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0810 03:18:15.549772 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:18:15.554255 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21242
I20260810 03:18:15.555490 21333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:15.660353 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21242
I20260810 03:18:15.688767 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21357
I20260810 03:18:15.689886 21443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:15.793958 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21357
I20260810 03:18:15.820384 18881 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu pid 21465
I20260810 03:18:15.821484 21556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 03:18:15.924513 18881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJGLf1q/build/asan/bin/kudu with pid 21465
2026-08-10T03:18:15Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4625 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9044 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (359049 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST